-- Logs begin at Mon 2022-08-01 15:28:52 UTC, end at Mon 2022-08-01 17:23:32 UTC. -- Aug 01 16:46:00.037195 dv-cinder-849890-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 16:46:00.046469 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:46:00 2022] *** Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: nodename: dv-cinder-849890-2-iscsi Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: machine: x86_64 Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: clock source: unix Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: pcre jit disabled Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: detected number of CPU cores: 4 Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: current working directory: / Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:46:00.049237 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: your processes number limit is 47680 Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: your memory page size is 4096 bytes Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: detected max file descriptor number: 2048 Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: lock engine: pthread robust mutexes Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: thunder lock: enabled Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 16:46:00.049905 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:46:00.088265 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: Python main interpreter initialized at 0x56302f4ff9c0 Aug 01 16:46:00.088265 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: python threads support enabled Aug 01 16:46:00.088265 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: your server socket listen backlog is limited to 100 connections Aug 01 16:46:00.088265 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:46:00.088630 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:46:00.088707 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: *** Operational MODE: preforking *** Aug 01 16:46:00.088933 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:46:00.088933 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: spawned uWSGI master process (pid: 110308) Aug 01 16:46:00.089130 dv-cinder-849890-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 16:46:00.090554 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: spawned uWSGI worker 1 (pid: 110309, cores: 1) Aug 01 16:46:00.090554 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: spawned uWSGI worker 2 (pid: 110310, cores: 1) Aug 01 16:46:00.090554 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:46:00.747972 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:46:00.749082 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:46:01.838878 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:46:01.838878 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: from cryptography.utils import int_from_bytes Aug 01 16:46:01.839485 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:46:01.839485 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: from cryptography.utils import int_from_bytes Aug 01 16:46:01.839630 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:46:01.839630 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: from cryptography.utils import int_from_bytes Aug 01 16:46:01.840013 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:46:01.840013 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: from cryptography.utils import int_from_bytes Aug 01 16:46:04.327418 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:46:04.328060 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:46:04.328198 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:46:04.328566 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:46:04.328688 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:46:04.329058 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:46:04.329143 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:46:04.329236 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.329388 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:46:04.329516 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.329754 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:46:04.329844 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.330014 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:46:04.330178 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.330427 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.330521 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.330756 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.330845 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331082 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331178 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331407 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331494 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331742 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.331842 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332009 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332104 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332331 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332418 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332662 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-2-iscsi {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332766 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.332991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333097 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333251 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333338 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333572 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333666 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333901 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-2-iscsi {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.333987 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.334231 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.334325 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.334555 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.334642 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.334876 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.335011 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.335180 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.335362 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.335521 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.336655 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.336857 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337048 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337236 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337236 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337574 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337812 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.337990 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.338198 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.338388 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.338577 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.338736 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.338914 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.339127 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.339284 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.339510 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.339689 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.339876 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340068 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340253 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340458 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-2-iscsi {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340635 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340794 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.340970 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.341184 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.341378 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342068 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342214 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-2-iscsi {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342366 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342506 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342638 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.342795 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343023 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343161 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343294 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343448 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343585 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343710 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343843 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.343967 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344098 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344229 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344473 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344604 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344746 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.344902 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345027 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345165 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345297 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345421 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345553 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345684 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345816 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.345947 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346095 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346233 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346366 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346490 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346621 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346745 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.346868 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347009 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347146 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347279 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347600 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347733 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.347866 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348006 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348131 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348259 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348382 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348507 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348642 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348769 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.348893 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349016 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349143 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349275 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349410 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349535 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349660 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349782 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.349906 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350057 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350209 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350347 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350471 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350594 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350718 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350855 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.350987 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351119 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351244 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351367 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351490 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351621 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351752 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.351885 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352015 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352139 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352264 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352395 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352530 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352655 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352774 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.352898 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353030 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353154 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353286 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353411 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353544 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353670 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353802 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.353927 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354078 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354204 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354339 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354571 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354709 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354834 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.354958 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355081 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355204 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355336 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355470 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355602 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355727 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.355875 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356003 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356188 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356317 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356499 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356627 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356823 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.356961 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.357131 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.357983 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358137 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358275 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358409 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358544 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358679 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358803 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.358927 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359103 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359242 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359411 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359550 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359724 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.359867 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360037 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360166 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360351 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360480 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360662 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360790 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.360972 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361136 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361272 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361402 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361581 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361719 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.361890 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362016 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362222 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362536 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362672 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362847 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.362975 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363155 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363282 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363464 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363599 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363776 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.363922 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364085 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364212 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364402 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364552 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364751 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.364878 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365012 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365147 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365311 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365439 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365618 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365744 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.365927 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366074 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366274 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366411 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366584 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366710 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.366892 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367027 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367212 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367339 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367514 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367729 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367862 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.367999 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368195 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368329 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368462 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368597 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368728 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.368860 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369012 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369145 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369320 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369455 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369626 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369760 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.369931 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370135 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370263 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370406 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370564 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370702 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370866 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.370992 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371170 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371297 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371478 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371605 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371782 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.371909 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372093 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372220 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372402 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372530 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372714 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.372840 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.373112 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.373240 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.373450 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.373577 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.373775 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:46:04.373909 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374128 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374269 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374467 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374596 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374809 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.374944 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375128 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375225 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375443 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375538 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375763 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.375867 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376093 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376188 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376409 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376503 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376722 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.376826 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377039 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377134 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377354 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377456 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377672 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377766 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.377990 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378106 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378333 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378430 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378655 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378749 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.378976 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379063 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379295 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379382 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379614 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379709 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.379940 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380028 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380259 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380346 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380571 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380657 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380904 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.380990 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381232 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381318 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381552 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381640 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381881 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.381974 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.382501 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.382592 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.382808 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.382904 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383123 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383229 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383435 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383529 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383762 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.383857 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384076 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384169 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384399 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384494 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384718 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.384810 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385035 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385137 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385351 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385454 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385664 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385757 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.385977 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386094 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386316 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386410 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386629 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386714 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.386948 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387034 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387266 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387365 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387579 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387665 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387901 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.387995 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.388221 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.388308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389067 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389164 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389384 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389470 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389700 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.389787 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390018 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390126 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390366 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390452 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390679 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390768 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.390993 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391092 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391304 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391391 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391621 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391710 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.391933 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392025 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392258 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392347 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392567 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392659 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392887 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.392984 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393204 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393307 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393518 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393604 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393828 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.393912 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394167 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394275 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394483 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394569 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394788 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.394874 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395110 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395207 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395424 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395508 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395734 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.395818 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396059 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396158 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396371 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396464 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396680 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396765 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.396996 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397082 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397310 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397403 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397623 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397709 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.397935 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398021 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398275 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398362 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398592 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398678 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398906 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.398992 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399219 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399309 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399550 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399645 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399870 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.399957 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400175 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400259 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400505 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400599 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400833 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.400920 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401139 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401225 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401447 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401540 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401764 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.401852 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402096 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402197 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402407 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402508 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402716 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.402862 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403025 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403117 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403328 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403467 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403634 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403719 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.403939 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.404031 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.404294 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.404382 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.404636 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.404730 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405003 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405090 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405315 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405403 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405624 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405743 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.405931 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406016 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406264 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406352 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406575 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406660 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406884 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.406970 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407192 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407280 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407540 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407634 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407850 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.407945 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408171 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408256 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408487 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408573 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408807 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.408904 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409121 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409208 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409435 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409521 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409748 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.409842 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410082 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410172 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410402 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410497 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410714 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.410808 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411028 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411113 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411338 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411425 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411656 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411742 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.411972 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412057 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412283 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412367 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412589 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412674 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412906 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.412998 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413226 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413311 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413535 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413623 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413854 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.413940 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414215 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414312 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414531 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414618 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414847 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.414933 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415160 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415246 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415475 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415562 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415785 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.415869 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416097 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416195 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416411 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416504 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416722 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.416806 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417034 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417127 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417345 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417437 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417661 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417746 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.417971 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418102 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418311 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418405 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418616 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418702 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.418933 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.419027 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.419254 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.419339 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.419562 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.420149 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.420413 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.420501 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.420726 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.420818 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421053 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421145 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421367 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421457 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421682 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421768 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.421998 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422104 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422334 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422423 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422642 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422728 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.422955 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423048 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423272 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423360 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423585 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423672 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423899 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.423997 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424204 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424289 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424522 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424609 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424833 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.424926 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425137 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425222 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425443 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425529 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425758 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.425855 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426089 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426182 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426402 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426489 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426722 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.426819 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427045 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427131 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427355 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427441 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427665 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427760 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.427990 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428075 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428302 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428387 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428608 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428693 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.428917 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429004 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429226 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429312 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429534 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429620 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429843 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.429930 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430177 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430266 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430504 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430590 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430830 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.430918 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431140 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431238 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431454 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431546 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431767 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.431861 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432080 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432175 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432400 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432715 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.432800 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433028 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433171 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433342 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433435 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433656 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433750 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.433969 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434094 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434312 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434398 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434626 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434712 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.434939 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.435037 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.435253 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.435428 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436211 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436301 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436525 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436613 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436843 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.436931 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.437165 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.437259 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.437482 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.437736 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.437829 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.438096 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.438220 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.438420 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.438691 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.438789 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439031 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439126 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439352 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439451 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439676 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.439763 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440003 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440089 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440331 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440426 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440640 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440737 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.440955 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441048 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441266 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441354 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441574 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441680 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441889 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.441978 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442227 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442315 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442535 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442631 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442840 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.442934 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443147 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443284 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443454 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443553 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443761 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.443848 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444067 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444160 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444376 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444471 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444692 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.444778 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445001 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445087 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445315 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445410 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445621 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445715 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.445946 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446059 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446286 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446452 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446609 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446741 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446900 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.446986 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447207 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447302 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447520 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447605 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447830 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.447951 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448138 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448226 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448484 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448571 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448795 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.448881 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449122 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449208 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449431 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449518 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449757 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.449853 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450090 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450192 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450397 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450483 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450704 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.450799 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451044 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451139 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451357 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451583 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451729 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451895 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.451991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452213 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452300 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452529 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452615 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452841 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.452929 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453159 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453262 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453472 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453778 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.453871 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454113 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454200 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454425 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454520 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454734 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.454827 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455040 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455133 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455352 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455449 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455664 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.455972 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456058 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456279 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456373 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456585 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456671 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456896 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.456982 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457200 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457286 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457507 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457592 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457812 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.457896 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458146 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458236 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458455 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458542 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458759 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.458852 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459066 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459191 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459378 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459465 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459684 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459769 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.459990 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460077 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460299 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460386 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460606 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460701 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460912 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.460998 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461218 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461304 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461530 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461631 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461840 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.461932 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462172 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462272 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462485 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462579 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462792 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.462891 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463098 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463186 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463404 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463500 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463715 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.463809 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464018 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464104 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464323 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464418 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464627 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464713 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.464929 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465014 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465321 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465545 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465632 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465850 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.465943 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466177 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466267 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466486 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466590 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466815 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.466934 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467136 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467223 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467444 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467530 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.467847 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468059 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468146 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468395 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468479 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468701 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.468800 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469016 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469100 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469332 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469418 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469651 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469746 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.469961 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470072 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470307 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470394 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470622 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470719 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.470939 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471030 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471245 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471337 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471552 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471650 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471869 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.471961 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472189 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472273 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472495 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472581 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472807 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.472894 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473130 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473214 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473445 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473577 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473751 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.473845 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474086 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474177 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474403 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474491 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474717 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.474804 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475025 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475119 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475334 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475429 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475648 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475736 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.475958 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476060 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476270 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476355 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476582 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476671 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476893 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.476987 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477203 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477290 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477514 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477600 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477824 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.477917 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478161 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478248 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478473 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478559 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478785 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.478887 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479092 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479180 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479400 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479485 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479704 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.479790 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480018 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480111 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480322 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480408 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480636 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480747 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.480945 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481062 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481259 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481374 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481566 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.481998 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.482104 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.482878 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.482965 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.483199 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.483406 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.483517 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.483724 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.483819 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484042 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484231 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484363 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484547 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484687 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.484861 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485008 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485176 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485322 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485484 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485754 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.485846 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486093 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486196 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486416 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486504 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486730 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.486814 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487039 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487125 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487343 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487435 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487656 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487752 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.487962 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488046 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488279 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488370 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488588 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488683 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488897 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.488989 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.489223 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.489310 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.489532 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.489696 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.489856 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490010 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490307 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490402 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490625 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490723 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.490936 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491022 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491280 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491364 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491588 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491682 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491905 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.491999 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492217 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492309 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492546 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492641 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492873 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.492960 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493187 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493281 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493505 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493590 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493811 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.493903 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494160 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494250 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494482 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494566 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494797 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.494892 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495117 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495210 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495435 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495529 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495764 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.495860 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496093 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496180 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496413 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496512 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496739 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.496826 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497051 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497160 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497361 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497489 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497673 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.497874 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.498659 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.498942 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499140 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499276 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499472 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499597 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499788 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.499875 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500107 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500206 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500423 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500510 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500738 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.500824 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501048 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501135 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501355 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501449 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501768 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.501991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502125 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502330 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502427 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502643 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502737 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.502955 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503042 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503277 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503361 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503585 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503676 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503907 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.503992 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504222 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504309 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504530 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504624 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504838 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.504925 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505144 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505237 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505468 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505563 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505783 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.505870 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506123 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506246 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506434 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506532 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506740 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.506828 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.507076 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.507408 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.507637 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.507731 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.507960 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508047 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508289 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508375 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508611 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508705 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.508923 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509009 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509233 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509325 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509546 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509634 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509865 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.509950 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510196 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510286 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510506 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510594 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510814 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.510908 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511121 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511206 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511426 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511555 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511732 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.511819 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512130 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512344 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512432 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512656 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512742 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.512961 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513055 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513269 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513355 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513600 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513688 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.513926 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514079 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514264 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514352 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514590 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514677 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.514904 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515003 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515212 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515300 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515519 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515606 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515827 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.515922 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516179 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516266 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516489 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516583 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516828 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.516918 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517145 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517230 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517466 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517553 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517787 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.517882 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518124 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518225 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518440 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518526 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518758 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.518845 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519075 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519161 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519388 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519482 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519703 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.519825 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520018 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520103 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520334 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520429 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520652 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520853 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.520965 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521187 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521280 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521504 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521592 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521822 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.521915 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.522171 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.522428 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.522527 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.522772 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.522859 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523097 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523183 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523408 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523494 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523720 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.523807 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524034 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524120 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524353 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524440 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524672 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524759 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.524990 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525085 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525307 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525395 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525626 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525713 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.525938 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526083 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526280 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526380 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526598 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526685 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.526947 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527041 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527264 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527350 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527577 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527663 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527894 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.527979 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528209 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528294 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528528 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528622 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528844 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.528944 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529197 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529298 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529507 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529665 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529821 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.529997 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530160 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530346 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530475 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530667 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530793 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.530986 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531111 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531307 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531439 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531628 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531778 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.531947 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532105 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532266 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532421 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532586 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532741 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.532908 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533061 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533239 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533583 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533671 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533898 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.533984 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534247 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534375 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534670 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534889 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.534983 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.535205 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.535411 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.535510 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.535732 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.535820 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536074 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536161 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536405 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536535 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536724 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.536819 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537035 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537122 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537344 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537438 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537670 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537757 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.537978 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538083 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538309 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538401 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538623 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538710 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.538932 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539017 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539240 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539467 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539554 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539815 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.539902 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540137 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540226 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540465 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540553 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540775 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.540861 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541102 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541308 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541396 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541657 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541743 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.541979 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542109 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542338 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542425 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542661 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542756 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.542979 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543075 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543290 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543383 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543599 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543693 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.543914 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.544002 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.544223 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.544307 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.544530 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.544616 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.545459 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.545658 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.545774 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.545977 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546131 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546321 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546444 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546640 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546758 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.546963 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547059 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547373 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547595 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547683 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.547905 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548003 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548238 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548326 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548548 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548632 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548856 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.548941 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549164 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549250 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549477 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549564 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549783 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.549868 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550116 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550208 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550425 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550511 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550733 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.550834 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551051 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551139 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551362 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551449 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551677 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551780 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.551984 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552070 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552298 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552383 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552608 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552703 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.552922 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553010 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553241 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553326 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553556 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553652 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553883 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.553969 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.554219 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.554317 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.554540 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.554750 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.554845 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555087 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555174 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555412 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555508 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555748 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.555835 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556081 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556169 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556393 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556487 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556704 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.556947 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557034 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557293 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557379 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557618 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557706 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.557929 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558015 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558266 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558356 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558583 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558671 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558895 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.558981 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559204 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559303 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559514 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559600 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559829 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.559916 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.560140 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.560278 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561022 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561113 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561340 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561470 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561655 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561750 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.561965 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562103 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562304 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562394 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562617 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562705 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.562933 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563021 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563248 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563335 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563562 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563649 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563876 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.563970 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564189 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564276 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564502 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564623 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564815 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.564909 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565127 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565223 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565440 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565534 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565758 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.565851 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566096 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566197 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566418 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566504 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566727 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.566848 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567038 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567133 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567352 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567439 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567668 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567754 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.567988 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568075 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568320 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568415 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568640 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568727 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.568948 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569035 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569293 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569379 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569617 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569703 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.569932 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570019 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570288 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570376 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570624 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570721 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.570952 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571047 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571277 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571363 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571587 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571683 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571895 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.571981 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572205 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572303 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572516 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572613 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572836 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.572923 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573153 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573238 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573460 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573558 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573768 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.573855 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574106 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574207 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574417 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574504 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574720 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.574806 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575028 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575115 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575337 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575425 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575643 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575728 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.575977 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576108 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576279 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576357 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576594 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576695 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576896 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.576993 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577203 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577296 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577555 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577657 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577821 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.577916 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578154 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578254 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578463 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578548 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578768 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.578862 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579075 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579167 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579382 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579474 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579692 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.579791 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580005 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580094 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580315 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580445 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580627 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580716 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.580938 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581025 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581245 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581340 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581553 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581641 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581875 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.581967 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582232 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582356 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582549 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582660 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582864 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.582970 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583182 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583278 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583509 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583607 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583822 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.583920 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584139 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584246 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584458 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584557 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584775 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.584877 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585088 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585183 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585418 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585504 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585733 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.585818 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586061 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586211 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586383 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586470 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586705 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.586790 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587018 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587112 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587335 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587422 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587648 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587742 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.587980 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588068 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588289 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588376 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588601 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588686 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.588916 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589004 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589235 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589330 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589549 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589645 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589862 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.589948 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590198 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590296 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590516 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590611 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590833 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.590925 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591148 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591234 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591466 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591657 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591823 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.591943 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592144 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592231 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592463 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592571 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592776 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.592864 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593098 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593186 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593418 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593506 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593749 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.593835 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594101 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594191 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594421 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594511 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594753 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.594847 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.595078 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.595163 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.595328 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:46:04.595416 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.595732 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.596080 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.596422 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.596743 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.597060 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.597373 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:46:04.597622 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:46:04.749673 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO dbcounter [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Registered counter for database nova_api Aug 01 16:46:04.751518 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Registered counter for database nova_api Aug 01 16:46:04.769993 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.771468 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.776569 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writer thread running {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:04.777912 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:04.832621 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.context [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcd62dae-a339-4b43-b5a0-7436faac276b(cell1) {{(pid=110309) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:46:04.833667 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.context [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcd62dae-a339-4b43-b5a0-7436faac276b(cell1) {{(pid=110310) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:46:04.836499 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.837566 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.838116 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.838921 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.839196 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.839997 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.840911 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.842545 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.843459 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO dbcounter [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Registered counter for database nova_cell0 Aug 01 16:46:04.844656 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Registered counter for database nova_cell0 Aug 01 16:46:04.848891 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO dbcounter [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Registered counter for database nova_cell1 Aug 01 16:46:04.850278 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Registered counter for database nova_cell1 Aug 01 16:46:04.856235 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.858983 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.861635 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.862451 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:04.865609 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writer thread running {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:04.867141 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writer thread running {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:04.869374 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:04.870880 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:05.012352 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO dbcounter [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Registered counter for database nova_cell0 Aug 01 16:46:05.016420 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Registered counter for database nova_cell0 Aug 01 16:46:05.021587 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:05.025137 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:46:05.026216 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writer thread running {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:05.030023 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:46:05.416348 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: WARNING keystonemiddleware.auth_token [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:46:05.423816 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: WARNING keystonemiddleware.auth_token [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:46:05.443175 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:46:05.450428 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:46:05.764900 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: WARNING keystonemiddleware.auth_token [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:46:05.770883 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: WARNING keystonemiddleware.auth_token [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:46:05.776112 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56302f4ff9c0 pid: 110309 (default app) Aug 01 16:46:05.778200 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:05.779987 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Aug 01 16:46:05.780391 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Aug 1 16:46:05 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:05.793482 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:46:05.800050 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-aea6c050-5200-4ef9-9f44-b5f3b5ff8c43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:46:05.805241 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56302f4ff9c0 pid: 110310 (default app) Aug 01 16:47:24.460880 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:24.461886 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 01 16:47:24.462911 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:24.474620 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:24.475770 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell1:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:24.476807 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell0:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:24.477826 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:25.346877 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-5d727b8b-1302-4afe-9939-f0c200d450b8 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:25.380159 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-5d727b8b-1302-4afe-9939-f0c200d450b8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910637 Aug 01 16:47:25.388774 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Aug 1 16:47:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:27.581577 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:27.582611 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-b0ac81a5-4376-4266-8762-8c4e11f0134a None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 01 16:47:27.583220 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:28.033112 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-ba3daf66-d573-4b00-9ba3-bbd7ccf5e441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:28.053591 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:47:28.053591 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Aug 01 16:47:28.143453 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-ba3daf66-d573-4b00-9ba3-bbd7ccf5e441 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.554460 Aug 01 16:47:28.144042 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:47:28.158012 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_api:SELECT=3 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:28.159277 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_cell0:SELECT=3 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:28.160389 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_cell1:SELECT=3 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:28.161165 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:28.371025 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-56cbcdad-aa19-4cf7-9473-3bf748a745f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:28.375979 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:47:28.375979 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:47:28.514855 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-56cbcdad-aa19-4cf7-9473-3bf748a745f3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.362553 Aug 01 16:47:28.515457 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Aug 1 16:47:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:30.745613 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-ba3daf66-d573-4b00-9ba3-bbd7ccf5e441 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:30.746662 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-ba3daf66-d573-4b00-9ba3-bbd7ccf5e441 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 01 16:47:30.747055 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:31.406618 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-d9fb1f81-5d65-4bbf-a18f-2161af44fe3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:31.425765 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:47:31.425765 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:47:31.526268 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-d9fb1f81-5d65-4bbf-a18f-2161af44fe3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.772225 Aug 01 16:47:31.527074 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:31.539981 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3e23bf06-3341-4b32-aa5e-4724d309c5d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:31.542868 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:47:31.542868 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Aug 01 16:47:31.647357 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-3e23bf06-3341-4b32-aa5e-4724d309c5d0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111320 Aug 01 16:47:31.647924 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Aug 1 16:47:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:33.883131 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-d9fb1f81-5d65-4bbf-a18f-2161af44fe3c admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:33.884147 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-d9fb1f81-5d65-4bbf-a18f-2161af44fe3c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 01 16:47:33.884711 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:34.283429 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-07af497b-4400-45cf-854b-df4469887631 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:34.338506 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-07af497b-4400-45cf-854b-df4469887631 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447347 Aug 01 16:47:34.339016 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:34.351637 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-a8ed4ce0-19c8-44c8-9fbd-cfd223030074 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:34.421001 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-a8ed4ce0-19c8-44c8-9fbd-cfd223030074 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073236 Aug 01 16:47:34.421706 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Aug 1 16:47:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:47:36.618599 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-07af497b-4400-45cf-854b-df4469887631 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:36.619688 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-07af497b-4400-45cf-854b-df4469887631 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 01 16:47:36.620163 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:37.059044 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-95779eb0-228f-40e9-b4f3-c4c96ade8f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:37.146198 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-95779eb0-228f-40e9-b4f3-c4c96ade8f76 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519216 Aug 01 16:47:37.146993 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:47:37.159142 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-8997cff0-2112-4299-b864-3df73976099b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:37.246526 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-8997cff0-2112-4299-b864-3df73976099b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090868 Aug 01 16:47:37.247013 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Aug 1 16:47:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:39.464388 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-95779eb0-228f-40e9-b4f3-c4c96ade8f76 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:39.465452 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-95779eb0-228f-40e9-b4f3-c4c96ade8f76 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 01 16:47:39.465846 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:39.891194 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:39.955576 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483058 Aug 01 16:47:39.956274 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:39.969745 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-7063dffd-281e-4644-860f-47b77333d45f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:40.027607 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-7063dffd-281e-4644-860f-47b77333d45f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062997 Aug 01 16:47:40.028323 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Aug 1 16:47:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:47:42.260717 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:42.261718 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 01 16:47:42.262138 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:42.841040 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-d769455a-877a-44f0-beb1-e750b9cbd008 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:42.867575 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-d769455a-877a-44f0-beb1-e750b9cbd008 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.598747 Aug 01 16:47:42.868222 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Aug 1 16:47:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:47:45.108342 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:45.109340 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-9afdef89-199e-4429-b113-3a16691952eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 01 16:47:45.109737 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:45.537985 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-88fce61c-90d8-4b36-a8dc-3e599d13dfca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:45.624471 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-88fce61c-90d8-4b36-a8dc-3e599d13dfca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.507273 Aug 01 16:47:45.625185 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:45.639357 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-9382e1df-0a83-4a61-902e-960c5196c901 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:45.698561 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-9382e1df-0a83-4a61-902e-960c5196c901 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063054 Aug 01 16:47:45.699187 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Aug 1 16:47:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:47.890175 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-88fce61c-90d8-4b36-a8dc-3e599d13dfca admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:47.891196 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-88fce61c-90d8-4b36-a8dc-3e599d13dfca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 01 16:47:47.891753 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:48.290407 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-0c96dc3e-bc0c-411b-8a92-187dbb8e04ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "id": "2"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:48.367276 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-0c96dc3e-bc0c-411b-8a92-187dbb8e04ba admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469798 Aug 01 16:47:48.367889 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:47:48.379993 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-61f6abf2-5ad8-4b86-889b-359c02643b76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:48.462770 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-61f6abf2-5ad8-4b86-889b-359c02643b76 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086393 Aug 01 16:47:48.463358 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Aug 1 16:47:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:50.680400 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-0c96dc3e-bc0c-411b-8a92-187dbb8e04ba admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:50.680400 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-0c96dc3e-bc0c-411b-8a92-187dbb8e04ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 01 16:47:50.680400 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:51.054426 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-8de2d395-eb68-4d59-bedd-e27cc8b53e6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "name": "m1.medium"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:51.120032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-8de2d395-eb68-4d59-bedd-e27cc8b53e6a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435725 Aug 01 16:47:51.120753 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:51.132892 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-e4b1cf1e-9ba2-43bb-bb0f-cd3da3dde3e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:51.228603 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-e4b1cf1e-9ba2-43bb-bb0f-cd3da3dde3e2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099578 Aug 01 16:47:51.229182 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Aug 1 16:47:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:53.457526 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-8de2d395-eb68-4d59-bedd-e27cc8b53e6a admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:53.459187 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-8de2d395-eb68-4d59-bedd-e27cc8b53e6a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Aug 01 16:47:53.460008 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:53.931579 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f38f0786-ce7f-46aa-b820-ce036bd679ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:54.692352 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:54.699988 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f38f0786-ce7f-46aa-b820-ce036bd679ca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.234532 Aug 01 16:47:54.700561 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:47:54.712904 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-176e51db-19d5-4b09-86fb-e0ce0b290e03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:54.839639 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-176e51db-19d5-4b09-86fb-e0ce0b290e03 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130597 Aug 01 16:47:54.840224 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Aug 1 16:47:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:57.103176 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f38f0786-ce7f-46aa-b820-ce036bd679ca admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:57.107175 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f38f0786-ce7f-46aa-b820-ce036bd679ca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 01 16:47:57.107175 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:57.564198 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:57.642175 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.528279 Aug 01 16:47:57.643222 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Aug 1 16:47:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:47:57.655697 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-1c44cd3b-0c47-4e02-92b9-8046e0cacabb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:57.749138 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-1c44cd3b-0c47-4e02-92b9-8046e0cacabb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098061 Aug 01 16:47:57.749771 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Aug 1 16:47:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:17.500425 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:17.501423 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 01 16:48:17.501815 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:17.891564 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-bd626b27-824b-498a-90ef-89f760e94125 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:17.910869 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-bd626b27-824b-498a-90ef-89f760e94125 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402896 Aug 01 16:48:17.911351 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Aug 1 16:48:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:48:18.977910 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:18.978941 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-5f6ffe5c-4d21-44c3-b913-f88c7c4ec38e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 01 16:48:18.979330 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:19.499570 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-844339bf-36fe-4a84-a1e4-0697dfb937ba admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:19.505349 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-844339bf-36fe-4a84-a1e4-0697dfb937ba admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-844339bf-36fe-4a84-a1e4-0697dfb937ba admin admin] Request method failure captured: Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept: application/json Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Connection: keep-alive Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Content-Length: 0 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Host: 10.222.0.20 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABi6APS5loo13Y9JKf3Q5XCSPnk3_tt7i_p5yjc6Htn4xc9THujbrjUdGqW9yolkPqqsMH8JeTKZaK4HepTK3fsTAeq573aU7CuwdayGslfiPOmrUHC56CcMdVkzaEryIw2ziZGaneVncdgpWuIgUer7VqceDPC7uDpR7tdP_o3eXVjZI8 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Role: member,reader,admin Aug 01 16:48:19.508598 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Roles: member,reader,admin Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant: admin Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User: admin Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Name: admin Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: method: > Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: exception: Flavor 42 could not be found. Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: action_args: {'id': '42'} Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:19.510277 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:19.511225 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.512365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-844339bf-36fe-4a84-a1e4-0697dfb937ba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:19.513605 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-844339bf-36fe-4a84-a1e4-0697dfb937ba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393754 Aug 01 16:48:19.513605 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 1 16:48:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:19.519597 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-eb4027b1-9bb3-46b1-96d1-f977471c0561 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:19.523895 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:19.542360 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-eb4027b1-9bb3-46b1-96d1-f977471c0561 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026269 Aug 01 16:48:19.542920 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:48:19.553155 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-dccac503-d1d2-470a-a799-8ed3c8051abf admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:19.577139 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-dccac503-d1d2-470a-a799-8ed3c8051abf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027499 Aug 01 16:48:19.577666 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:48:19.587027 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-fe17508b-7b51-4427-9d0d-54d9c608e2ec admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:19.593234 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.wsgi [None req-fe17508b-7b51-4427-9d0d-54d9c608e2ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-fe17508b-7b51-4427-9d0d-54d9c608e2ec admin admin] Request method failure captured: Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept: application/json Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept-Encoding: gzip, deflate Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Connection: keep-alive Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Content-Length: 0 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Host: 10.222.0.20 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-System-Scope: None Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: User-Agent: python-novaclient Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Auth-Token: gAAAAABi6APS5loo13Y9JKf3Q5XCSPnk3_tt7i_p5yjc6Htn4xc9THujbrjUdGqW9yolkPqqsMH8JeTKZaK4HepTK3fsTAeq573aU7CuwdayGslfiPOmrUHC56CcMdVkzaEryIw2ziZGaneVncdgpWuIgUer7VqceDPC7uDpR7tdP_o3eXVjZI8 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Id: None Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Name: None Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Identity-Status: Confirmed Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Is-Admin-Project: True Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Id: default Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Name: Default Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Name: admin Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Role: member,reader,admin Aug 01 16:48:19.596500 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Roles: member,reader,admin Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant: admin Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Name: admin Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User: admin Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Id: default Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Name: Default Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Name: admin Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: method: > Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: exception: Flavor 42 could not be found. Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: action_args: {'id': '42'} Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:19.598308 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:19.599359 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:19.600635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-fe17508b-7b51-4427-9d0d-54d9c608e2ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:19.601871 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-fe17508b-7b51-4427-9d0d-54d9c608e2ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014483 Aug 01 16:48:19.601871 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 1 16:48:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:20.561455 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-dccac503-d1d2-470a-a799-8ed3c8051abf admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:20.562592 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-dccac503-d1d2-470a-a799-8ed3c8051abf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 01 16:48:20.562988 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:21.091353 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-4d38d349-fb78-4e50-a90a-90d7043240d2 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:21.096972 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.wsgi [None req-4d38d349-fb78-4e50-a90a-90d7043240d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-4d38d349-fb78-4e50-a90a-90d7043240d2 admin admin] Request method failure captured: Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept: application/json Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept-Encoding: gzip, deflate Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Connection: keep-alive Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Content-Length: 0 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Host: 10.222.0.20 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-System-Scope: None Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: User-Agent: python-novaclient Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Auth-Token: gAAAAABi6APUoIoexo0siQonoYNw087VTED5m4fn2ea_3W9fZ6YKhgspCJhz66Vgb90xbjeoHd184DpdR6GVHNMetVXZC6wkGiJ9W-15yCyLWf-7rsJOY0ixSLdFDctn39Xqx5XzGftqCGUCO_F9e0IF5NsPp5esB91kf3tEIFQd7MirUIuOm3U Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Id: None Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Name: None Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Identity-Status: Confirmed Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Is-Admin-Project: True Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Id: default Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Name: Default Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Name: admin Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Role: member,reader,admin Aug 01 16:48:21.098515 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Roles: member,reader,admin Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant: admin Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Name: admin Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User: admin Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Id: default Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Name: Default Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Name: admin Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: method: > Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: exception: Flavor 84 could not be found. Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: action_args: {'id': '84'} Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:21.100168 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:21.101156 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.102486 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-4d38d349-fb78-4e50-a90a-90d7043240d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:21.103730 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-4d38d349-fb78-4e50-a90a-90d7043240d2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398679 Aug 01 16:48:21.103730 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 1 16:48:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:21.110297 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-eb3aa0c2-495b-443a-a5cc-c11404a97575 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:21.125782 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-eb3aa0c2-495b-443a-a5cc-c11404a97575 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019920 Aug 01 16:48:21.126365 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:48:21.135643 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-7a5a25d7-a896-49ad-99ce-7a0a575be06d admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:21.150329 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-7a5a25d7-a896-49ad-99ce-7a0a575be06d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018076 Aug 01 16:48:21.150854 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:48:21.159755 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-51a1e5a2-f47e-4a55-88b3-cd68f18bc445 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:21.164985 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-51a1e5a2-f47e-4a55-88b3-cd68f18bc445 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-51a1e5a2-f47e-4a55-88b3-cd68f18bc445 admin admin] Request method failure captured: Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept: application/json Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Connection: keep-alive Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Content-Length: 0 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Host: 10.222.0.20 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABi6APUoIoexo0siQonoYNw087VTED5m4fn2ea_3W9fZ6YKhgspCJhz66Vgb90xbjeoHd184DpdR6GVHNMetVXZC6wkGiJ9W-15yCyLWf-7rsJOY0ixSLdFDctn39Xqx5XzGftqCGUCO_F9e0IF5NsPp5esB91kf3tEIFQd7MirUIuOm3U Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Role: member,reader,admin Aug 01 16:48:21.166498 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Roles: member,reader,admin Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant: admin Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User: admin Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Name: admin Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: method: > Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: exception: Flavor 84 could not be found. Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: action_args: {'id': '84'} Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:21.168036 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:21.169567 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:21.171056 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-51a1e5a2-f47e-4a55-88b3-cd68f18bc445 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:21.172296 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-51a1e5a2-f47e-4a55-88b3-cd68f18bc445 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011574 Aug 01 16:48:21.172296 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 1 16:48:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:22.169521 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-7a5a25d7-a896-49ad-99ce-7a0a575be06d admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:22.170561 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-7a5a25d7-a896-49ad-99ce-7a0a575be06d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 01 16:48:22.170960 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:22.690762 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f8301ad4-5469-4cc3-aff8-a8d27c7b08c1 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:22.696654 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-f8301ad4-5469-4cc3-aff8-a8d27c7b08c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f8301ad4-5469-4cc3-aff8-a8d27c7b08c1 admin admin] Request method failure captured: Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept: application/json Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Connection: keep-alive Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Content-Length: 0 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Host: 10.222.0.20 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABi6APWgvAjzQ0DRmM-i2s4rHdfUAhq6g3ZWzE_gn2zAITdGhDICdY200fEbl0h_f9Ic9z3UqTs9DhixDY3ablXTEPDf_br6OEhTQjRfNXztezHgUxW6G74DbbKFZ91HpfFf-UBXqYPWMAj-bBEbMjC2lvHi0E91xwMtLcZxVMRjt3obpY Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Role: member,reader,admin Aug 01 16:48:22.698235 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Roles: member,reader,admin Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant: admin Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User: admin Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: X-User-Name: admin Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: method: > Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: exception: Flavor 451 could not be found. Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: action_args: {'id': '451'} Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:22.699752 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:22.701735 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.702921 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f8301ad4-5469-4cc3-aff8-a8d27c7b08c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:22.704191 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f8301ad4-5469-4cc3-aff8-a8d27c7b08c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392379 Aug 01 16:48:22.704191 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:48:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:22.709346 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-07178551-1f5b-46fa-8cc9-bb9ad49a3dd6 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:22.724565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-07178551-1f5b-46fa-8cc9-bb9ad49a3dd6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018797 Aug 01 16:48:22.725096 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:48:22.735273 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:22.754000 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018961 Aug 01 16:48:22.754000 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 1 16:48:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:48:22.762122 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-e04e8325-95a1-45ea-ade0-0cb8f75020d8 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:22.767539 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.wsgi [None req-e04e8325-95a1-45ea-ade0-0cb8f75020d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-e04e8325-95a1-45ea-ade0-0cb8f75020d8 admin admin] Request method failure captured: Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept: application/json Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Accept-Encoding: gzip, deflate Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Connection: keep-alive Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Content-Length: 0 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Host: 10.222.0.20 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-Api-Version: compute 2.90 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Openstack-System-Scope: None Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: User-Agent: python-novaclient Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Auth-Token: gAAAAABi6APWgvAjzQ0DRmM-i2s4rHdfUAhq6g3ZWzE_gn2zAITdGhDICdY200fEbl0h_f9Ic9z3UqTs9DhixDY3ablXTEPDf_br6OEhTQjRfNXztezHgUxW6G74DbbKFZ91HpfFf-UBXqYPWMAj-bBEbMjC2lvHi0E91xwMtLcZxVMRjt3obpY Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Id: None Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Domain-Name: None Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Identity-Status: Confirmed Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Is-Admin-Project: True Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Id: default Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Domain-Name: Default Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Project-Name: admin Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Role: member,reader,admin Aug 01 16:48:22.769032 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Roles: member,reader,admin Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e43f22f36744d079b60704aff4969d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e43f22f36744d079b60704aff4969d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant: admin Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Id: 3e43f22f36744d079b60704aff4969d4 Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-Tenant-Name: admin Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User: admin Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Id: default Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Domain-Name: Default Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Id: 1007f8e379b74e169b98fb7c3c0ba5b4 Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: X-User-Name: admin Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: method: > Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: exception: Flavor 451 could not be found. Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: action_args: {'id': '451'} Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:22.770565 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:22.771681 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: ERROR nova.api.openstack.wsgi Aug 01 16:48:22.772991 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-e04e8325-95a1-45ea-ade0-0cb8f75020d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:22.774243 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-e04e8325-95a1-45ea-ade0-0cb8f75020d8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011818 Aug 01 16:48:22.774243 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:48:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:48:23.736994 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:23.737995 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 01 16:48:23.738418 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:24.262358 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-7970119a-e492-48f1-86d1-a4c4029bb348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:24.360590 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-7970119a-e492-48f1-86d1-a4c4029bb348 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481954 Aug 01 16:48:24.361139 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 1 16:48:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:48:25.333193 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:25.334217 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 01 16:48:25.334630 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:25.854348 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-4ee7dde6-efee-4c88-91f4-60833659bda3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:25.932864 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-4ee7dde6-efee-4c88-91f4-60833659bda3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.459556 Aug 01 16:48:25.933413 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 1 16:48:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:48:26.899609 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:26.900614 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 01 16:48:26.901007 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:27.422906 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-4fe154f2-aef9-48ab-99be-9dedd172df25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:27.474852 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-4fe154f2-aef9-48ab-99be-9dedd172df25 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.435652 Aug 01 16:48:27.475402 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 1 16:48:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:48:28.448623 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:28.449630 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 01 16:48:28.450114 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:28.973509 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-ced9123d-193c-430b-a883-d3acb1e0a983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:29.063174 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-ced9123d-193c-430b-a883-d3acb1e0a983 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.474028 Aug 01 16:48:29.063730 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 1 16:48:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:48:30.038562 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:30.039562 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 01 16:48:30.039955 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:30.566349 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-077105bc-4d5d-45ee-8739-c5d93ae50d38 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:30.586761 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-077105bc-4d5d-45ee-8739-c5d93ae50d38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408932 Aug 01 16:48:30.587299 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Aug 1 16:48:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:49:21.603878 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:21.604898 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f00e786f-8c4c-4b34-ba2a-c8aade19f5dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 01 16:49:21.605273 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Mon Aug 1 16:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:49:21.615393 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.010739 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-5c3c5af2-204e-439c-b770-bb7de656e035 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:22.031927 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-5c3c5af2-204e-439c-b770-bb7de656e035 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420901 Aug 01 16:49:22.032396 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Aug 1 16:49:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:49:22.062516 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-b1dbedb3-7c2b-485c-8886-9ae1049b3db1 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:22.069989 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.076203 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-b1dbedb3-7c2b-485c-8886-9ae1049b3db1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019053 Aug 01 16:49:22.078612 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Aug 1 16:49:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:22.091065 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-0a064e35-3d3a-4d11-adc0-ff220e4ddcd1 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:22.099091 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-0a064e35-3d3a-4d11-adc0-ff220e4ddcd1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013006 Aug 01 16:49:22.099632 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Aug 1 16:49:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:22.112972 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:22.120910 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011936 Aug 01 16:49:22.121374 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Aug 1 16:49:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:22.137647 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-14352dbb-7af3-42bf-be13-0142eb69ec97 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:22.145446 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-14352dbb-7af3-42bf-be13-0142eb69ec97 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011982 Aug 01 16:49:22.145985 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Aug 1 16:49:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:52:54.870712 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:54.871706 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Aug 01 16:52:54.872108 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:52:55.017753 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_api:SELECT=6 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:55.176635 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:55.179013 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:52:55.179013 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:52:55.180210 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:55.180649 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:55.181432 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:55.181856 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:55.216581 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-9aa65b66-c110-4a73-abdd-34c1f1041e07 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200216 Aug 01 16:52:55.217160 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:52:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:52:56.046333 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:56.047395 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 01 16:52:56.047787 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:52:56.239173 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:56.241518 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:52:56.241518 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:52:56.242733 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:56.243172 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:56.243972 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:56.244394 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:56.264004 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-93ee52db-a0db-4c8e-b9bb-8bb6d954ce6f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076637 Aug 01 16:52:56.264552 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:52:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:53:07.489954 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:07.491011 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 01 16:53:07.491404 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:53:07.637708 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_cell0:SELECT=4 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:07.638453 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_cell1:SELECT=4 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:07.639065 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG dbcounter [-] [110309] Writing DB stats nova_api:SELECT=8 {{(pid=110309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:07.686352 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:07.688742 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:07.688742 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:53:07.689916 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:07.690377 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:07.691158 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:07.691648 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:07.718411 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-7c8d5f65-71b6-425e-8e3c-fd14f24f336f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085764 Aug 01 16:53:07.718926 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:53:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:53:08.543408 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:08.544397 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-84bc24a3-fe92-498e-89d3-1dc45b449608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Aug 01 16:53:08.544784 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 1 16:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:53:08.733601 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG nova.api.openstack.wsgi [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] Calling method '>' {{(pid=110309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:08.735994 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:53:08.735994 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: warnings.warn(msg) Aug 01 16:53:08.737170 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:08.737605 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:08.738412 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:08.738835 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: DEBUG oslo_concurrency.lockutils [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:08.760766 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: INFO nova.api.openstack.requestlog [None req-ed2446c1-0bb5-4d75-b397-a70fe924a3c0 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078724 Aug 01 16:53:08.761242 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: [pid: 110309|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 1 16:53:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:54:05.832732 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: Mon Aug 1 16:54:05 2022 - graceful shutdown triggered... Aug 01 16:54:05.832869 dv-cinder-849890-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 16:54:05.833832 dv-cinder-849890-2-iscsi devstack@n-api.service[110310]: Gracefully killing worker 2 (pid: 110310)... Aug 01 16:54:05.834315 dv-cinder-849890-2-iscsi devstack@n-api.service[110309]: Gracefully killing worker 1 (pid: 110309)... Aug 01 16:54:06.834907 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: worker 1 buried after 1 seconds Aug 01 16:54:06.835452 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: worker 2 buried after 1 seconds Aug 01 16:54:06.835452 dv-cinder-849890-2-iscsi devstack@n-api.service[110308]: goodbye to uWSGI. Aug 01 16:54:06.836506 dv-cinder-849890-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 16:54:06.837058 dv-cinder-849890-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 16:54:06.839916 dv-cinder-849890-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 16:54:06.849576 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:54:06 2022] *** Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: nodename: dv-cinder-849890-2-iscsi Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: machine: x86_64 Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: clock source: unix Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: pcre jit disabled Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: detected number of CPU cores: 4 Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: current working directory: / Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:54:06.851635 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: your processes number limit is 47680 Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: your memory page size is 4096 bytes Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: detected max file descriptor number: 2048 Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: lock engine: pthread robust mutexes Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: thunder lock: enabled Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 16:54:06.852357 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:54:06.893489 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: Python main interpreter initialized at 0x56033eb639c0 Aug 01 16:54:06.893489 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: python threads support enabled Aug 01 16:54:06.893489 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: your server socket listen backlog is limited to 100 connections Aug 01 16:54:06.893489 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:54:06.893929 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:54:06.893929 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: *** Operational MODE: preforking *** Aug 01 16:54:06.894247 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:54:06.894247 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: spawned uWSGI master process (pid: 124814) Aug 01 16:54:06.894449 dv-cinder-849890-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 16:54:06.898139 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: spawned uWSGI worker 1 (pid: 124835, cores: 1) Aug 01 16:54:06.898139 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: spawned uWSGI worker 2 (pid: 124837, cores: 1) Aug 01 16:54:06.898139 dv-cinder-849890-2-iscsi devstack@n-api.service[124814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:54:07.561586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:54:07.565054 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:54:08.718499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:54:08.718499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: from cryptography.utils import int_from_bytes Aug 01 16:54:08.719176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:54:08.719176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: from cryptography.utils import int_from_bytes Aug 01 16:54:08.730425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:54:08.730425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: from cryptography.utils import int_from_bytes Aug 01 16:54:08.730957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:54:08.730957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: from cryptography.utils import int_from_bytes Aug 01 16:54:11.164989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:54:11.165594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:54:11.165702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:54:11.166094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:54:11.166358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:54:11.166755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.167087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.167419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.167750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.168087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.168403 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.168757 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.169089 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.169427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.169693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.170012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.170369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-2-iscsi {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.170696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.171180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.171499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.171825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.172135 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.172464 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.172821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.173285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.174024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.174362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.174740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.175278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.175603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.175925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.176258 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.176568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.176901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.177215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.177634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-2-iscsi {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.177959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.178310 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.178630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.179063 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.179386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.179701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.180024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.180350 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.180664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.181012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.181335 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.181659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.181985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.182321 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.182633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.182950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.183274 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.183582 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.184732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.184732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.184997 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.185318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.185671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.185956 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.186236 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.186494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.186803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.187178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.187446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.187777 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.188086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.188381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.188690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.189000 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.189309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.189623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.189944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.190291 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.193928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:54:11.194421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.194517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:54:11.194613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.194707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:54:11.194801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.194893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:54:11.194978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:54:11.195153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.195905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196000 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.196963 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197149 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197325 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197471 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.197909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-2-iscsi {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.198853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199073 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.199840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.200549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.200758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.200913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201619 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.201889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202129 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202443 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202754 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.202855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.203818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204013 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204651 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.204961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-2-iscsi {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.205923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.206931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207161 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207781 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.207879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208088 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208393 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.208793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.209032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.209357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.209669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.209976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210213 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210391 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.210967 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.211972 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.212188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.212299 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.212507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.212626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.212783 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.212878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.213085 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.213212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.213417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.213658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.213772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.213998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.214125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.214347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.214463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.214606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.214718 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.214938 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.215058 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.215270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.215991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.216647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.216807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.216963 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.217142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.217293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.217602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.217747 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.217897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.218083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.218192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.218283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.218362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.218434 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.218510 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.218645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.218720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.218840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.218929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.219164 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.219403 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.219511 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.219734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.219831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.220114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.220244 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.220432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.220543 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.220776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.220914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.221126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.221229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.221445 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.221547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.221775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.221877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.222127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.222223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.222477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.222577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.222808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.222914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.223068 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.223163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.223395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.223496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.223712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.223872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.224257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.224382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.224382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.224547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.224637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.224731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.224947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.225057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.225227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.225318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.225540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.225632 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.225885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.226000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.226250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.232307 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.232433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.232535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.232641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.232773 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.232871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.232966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.232966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.233170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.233270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.233359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.233450 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.233545 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.233633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.233725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.233841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.233932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.234165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.234440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.234527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.234698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.234861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.234961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.235158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.235259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.235434 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.235625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.235896 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.235995 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236081 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.236166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.236334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236426 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.236513 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.236709 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.236889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.236977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.237063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.237148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.237239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.237325 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.237419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.237506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.237634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.237741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.237843 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.237934 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.238024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.238156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.238255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.238344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.238439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.238527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.238620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.238736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.238831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.238933 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.239120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.239292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239379 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.239463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.239650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.239845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.239939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.240130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.240319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.240506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.240685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240781 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.240873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.240969 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.241055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.241250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.241487 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:54:11.241671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.241850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.241952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.242192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.242370 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.242541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.242690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.242853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.243002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.243351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.243738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.243926 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.244205 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.244518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.244851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.245169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.245525 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.245795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.246383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.246492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.246762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.246937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.247142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.247579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.247688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.247986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.248107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.248252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.248356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.248582 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.248694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.251985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.252090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.252171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.256246 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.256435 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.256683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.256861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.257836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.258523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.258685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.258848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259481 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.259961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260420 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.260920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.261196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.261361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.261829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.261829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.262890 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.263863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.264034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.264192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.264355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.264748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.265825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.266101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.266265 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.266519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.266700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.266860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267312 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267653 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.267971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268125 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268435 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268598 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268754 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.268900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.269977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270474 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.270921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.271079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.271235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.271395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.271543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.272588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.272715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.272839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.272839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273073 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273073 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.273877 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.274609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.275119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.278780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.278964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.279948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.280881 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281039 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281331 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.281827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.282297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.282489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.282827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.282992 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.283149 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.283369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.283526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.283675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.283829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.284027 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.284193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.284342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.284495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.284667 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285288 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285596 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285752 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.285906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.286864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287029 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287487 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.287933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288089 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.288989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289136 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289290 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.289897 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290086 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.290925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.291084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.291238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.291391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.291391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.292609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.292954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.293123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.293280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.293429 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.293586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.294342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.296827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.297977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298466 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.298922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.299858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.300857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301317 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.301937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.302142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.302361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.302823 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.303181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.303358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.303506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.303762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.303762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304271 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.304965 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.305130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.305514 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.305665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.305813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.306447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.306566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315075 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315383 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315843 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.315965 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316428 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.316890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317590 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.317968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318351 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.318820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319046 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319455 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.319999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320137 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320830 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.320955 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321507 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.321973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322230 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322230 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322565 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.322805 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323128 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323574 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.323866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324011 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324835 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.324987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.325887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326048 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.326992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.327900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.328959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.329979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.330960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331108 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.331981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.332869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.333036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.333256 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.333485 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.333739 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.333898 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334553 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.334940 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335415 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.335998 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336110 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.336931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337056 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337672 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.337915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.338025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.338160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.344815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345327 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.345913 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346719 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.346861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347004 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347679 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.347904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348679 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.348993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349280 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.349870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.350841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351835 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.351992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352451 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.352897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.353967 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.354202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.354381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.354533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.354689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.354948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.355243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.355410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.355410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.355701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.355860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.356021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.356712 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.356877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.357029 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.357198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.357348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.357830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.358104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.358280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.358441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359129 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359291 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.359932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360608 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.360767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361503 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361659 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361810 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.361958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.362316 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.362475 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.362648 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.362824 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.362983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363151 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.363973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364420 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.364895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365129 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.365966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.366097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.366214 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367066 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.367994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.368238 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.368420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.368573 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.368730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.368889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.369989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.370225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.370404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.370605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.370757 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.370917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.371327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.371492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.371682 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.373190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.373479 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.373479 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.373782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.373782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374421 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.374881 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.375040 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.375308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.375494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.375741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.375906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376056 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376213 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.376864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.377939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.378142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.378478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.378639 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.378809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.378966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.379893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380042 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.380900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381689 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.381849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382824 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.382989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.383918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384067 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384216 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384540 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.384860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.385018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.385176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.385344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.385608 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.385793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386697 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.386856 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387006 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387006 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.387852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388301 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.388891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.389993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.390182 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.390331 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.390480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.390688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.390844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.391002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.391160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.391329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.391490 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.391649 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.393949 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.395624 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.395887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.395887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.396334 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.396491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.396642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.396800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.396952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397268 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.397889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398066 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.398957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399109 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399728 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.399896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.400877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401035 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401820 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.401978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.402186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.402341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.402494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.402652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.402811 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.403862 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.404019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.404188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.404760 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.404940 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405092 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.405692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.406155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.406343 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.406586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.406742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.406918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.407086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.407808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.407976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408296 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408459 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.408991 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409155 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.409925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.410900 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411032 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411161 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411289 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411418 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.411947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412485 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412743 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.412879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413430 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413567 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.413979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.414366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.414939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.414939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.415923 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416300 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.416957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.417896 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.418024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.418222 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.418364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.418519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.419269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.419402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.419534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.419665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.419864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.420987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421253 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421651 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.421915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422200 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422603 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.422875 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423005 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423005 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.423950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.424070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.424189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.424301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.424425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.424545 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425224 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425811 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.425921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.426057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.426175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.430837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.431767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432655 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.432954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.433864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.434024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.435442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.435600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.435764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.435764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.436056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.436056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.436328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.436328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.436728 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.437819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.437981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438554 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.438999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.439992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.440902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.441868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442137 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.442892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443350 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.443932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444087 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444230 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.444882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.445025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.445609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.445770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.445924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.446995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.447957 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.448954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449403 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449826 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.449996 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.450926 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.451989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.452844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453573 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.453867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.454363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.454514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.454514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.454514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.454923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.455079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.455223 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.455801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.455801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456600 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.456937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.457896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.458645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.458782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.458782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459578 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.459696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460234 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.460941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461322 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.461911 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.462070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.462795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.462795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.462795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.462795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.463817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.463937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464051 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.464882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.465019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.465143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.465261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.465379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466016 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.466928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467501 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467622 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467622 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.467974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.468966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469300 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.469890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470300 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470422 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470422 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.470984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471396 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.471776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.472485 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.472615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.472730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.472842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.472975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473799 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.473917 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.474637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.474775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.474904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.475642 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.476537 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.476678 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.476800 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.476920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477152 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477800 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.477914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.478490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.479908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.480667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.481939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.482629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.483880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.484498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:54:11.485742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:54:11.508052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Registered counter for database nova_api Aug 01 16:54:11.529725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.534291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO dbcounter [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Registered counter for database nova_api Aug 01 16:54:11.536406 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.554755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_db.sqlalchemy.engines [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.561988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writer thread running {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.593683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.context [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcd62dae-a339-4b43-b5a0-7436faac276b(cell1) {{(pid=124837) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:54:11.597868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:54:11.599506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:54:11.600313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:54:11.602337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:54:11.604302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Registered counter for database nova_cell0 Aug 01 16:54:11.609017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Registered counter for database nova_cell1 Aug 01 16:54:11.616279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.617469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.context [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcd62dae-a339-4b43-b5a0-7436faac276b(cell1) {{(pid=124835) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:54:11.618012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.622630 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:54:11.624257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:54:11.624863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.625062 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:54:11.626537 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.627113 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:54:11.629098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO dbcounter [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Registered counter for database nova_cell0 Aug 01 16:54:11.633123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO dbcounter [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Registered counter for database nova_cell1 Aug 01 16:54:11.640445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_db.sqlalchemy.engines [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.642672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_db.sqlalchemy.engines [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.647288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writer thread running {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.653648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writer thread running {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.773950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Registered counter for database nova_cell0 Aug 01 16:54:11.781174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.785526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:11.798293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO dbcounter [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Registered counter for database nova_cell0 Aug 01 16:54:11.804858 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_db.sqlalchemy.engines [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:54:11.809775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writer thread running {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:54:12.110814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:54:12.118283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:54:12.133845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: WARNING keystonemiddleware.auth_token [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:54:12.141433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: WARNING keystonemiddleware.auth_token [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:54:12.468413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:54:12.474424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-ae83b94c-051d-4d70-bb16-e35e05a39f6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:54:12.479801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56033eb639c0 pid: 124837 (default app) Aug 01 16:54:12.486502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: WARNING keystonemiddleware.auth_token [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:54:12.492559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: WARNING keystonemiddleware.auth_token [None req-d4f7feed-acd6-4486-8740-fa982f749382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:54:12.498330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56033eb639c0 pid: 124835 (default app) Aug 01 16:54:55.183196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.184213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.185188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.186071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:56.669015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-75b2e9ec-d5b0-4c23-b8a6-7f146cf9c12a tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Action: 'create', calling method: .version_select at 0x7f733fa84ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-892369206"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:54:59.230096 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-75b2e9ec-d5b0-4c23-b8a6-7f146cf9c12a tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.055933 Aug 01 16:54:59.239927 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Aug 1 16:54:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 16:54:59.254932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:59.258106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:59.263157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:59.265570 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:59.762436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-069ed5b7-03fb-48c8-a1d3-cc65a5949fcb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733faf7b80>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:01.117491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-069ed5b7-03fb-48c8-a1d3-cc65a5949fcb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 200 len: 345 microversion: 2.1 time: 1.873664 Aug 01 16:55:01.118343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:54:59 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 345 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:01.146124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9c0d8b41-5720-4fe9-9521-52b497766d89 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Action: 'create', calling method: .version_select at 0x7f733f908ca0>, body: {"snapshot": {"volume_id": "423a923c-9471-4c83-a49f-19b531c89b81", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1826016425"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:02.306481 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9c0d8b41-5720-4fe9-9521-52b497766d89 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.176291 Aug 01 16:55:02.316320 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 1 16:55:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:02.333206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8dba0202-3de6-40da-b13d-d9efa4f76678 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f93dca0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:03.010655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8dba0202-3de6-40da-b13d-d9efa4f76678 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.691180 Aug 01 16:55:03.011793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:02 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:03.023439 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ae71c1e0-3a3a-4957-a7d2-e5e0dbaa5a1d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f919e50>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:03.172267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ae71c1e0-3a3a-4957-a7d2-e5e0dbaa5a1d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.150244 Aug 01 16:55:03.172885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 1 16:55:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:03.186864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fb83438e-72bd-49eb-ac2d-23e9c9b78aec tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f8ff4c0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:03.366306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fb83438e-72bd-49eb-ac2d-23e9c9b78aec tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.186025 Aug 01 16:55:03.367727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:03 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:04.382001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d1a97120-32ce-4d4c-b8ca-024031dadfc9 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f919ca0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:04.590758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d1a97120-32ce-4d4c-b8ca-024031dadfc9 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.213818 Aug 01 16:55:04.592184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:04 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:05.603663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1a77a9da-0cfa-439e-b136-a90500037905 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f919430>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:05.723999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1a77a9da-0cfa-439e-b136-a90500037905 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.124006 Aug 01 16:55:05.724919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:05 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:05.845164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1512065259", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "networks": [{"uuid": "3d662af2-6e65-422b-93ad-8c32bc2d82d8"}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:06.033541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] validate_networks() for [('3d662af2-6e65-422b-93ad-8c32bc2d82d8', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:55:06.740368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9004d142-e4ef-41f2-89a0-9a5aa77d69f0 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f908dc0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:06.823920 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9004d142-e4ef-41f2-89a0-9a5aa77d69f0 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.086611 Aug 01 16:55:06.824791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:06 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:07.839982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-98d8b938-fe94-4b77-9702-29007e4e579e tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f908f70>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:07.907438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-98d8b938-fe94-4b77-9702-29007e4e579e tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.074025 Aug 01 16:55:07.912235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 7/10] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:07 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:07.974198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:55:07.975240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:55:07.975740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:55:07.976956 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:55:07.978021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:55:08.012576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:08.013362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:08.016055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:08.018631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:08.057024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Getting quotas for project 704a245a8de14350b5ffe3d1d13ca1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:55:08.065324 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Getting quotas for user 0d90db97f4334c41ba8e0e54fc14c317 and project 704a245a8de14350b5ffe3d1d13ca1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:55:08.079429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:55:08.090975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:55:08.277320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4b7d838f-c13b-4ded-84fe-f6da78118a04 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.797162 Aug 01 16:55:08.278415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 4/11] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:55:08.292741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9651206e-adb1-44ff-a0c7-bea757f1ad80 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:08.293595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9651206e-adb1-44ff-a0c7-bea757f1ad80 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:08.480765 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9651206e-adb1-44ff-a0c7-bea757f1ad80 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:08.509713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9651206e-adb1-44ff-a0c7-bea757f1ad80 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1215 microversion: 2.1 time: 0.221452 Aug 01 16:55:08.515947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:08 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:08.922448 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a526fe43-bec5-40fe-9fb0-d3ac6d8406e0 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f91e5e0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:09.010174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a526fe43-bec5-40fe-9fb0-d3ac6d8406e0 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.093237 Aug 01 16:55:09.011180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 9/13] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:08 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:09.139544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f54319d9-5233-46c4-bddb-7523f0dc120a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: .version_select at 0x7f733f0168b0>, body: {"keypair": {"name": "tempest-keypair-1529675577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnX6RaZWHV2xORkg+UelQIRE3ptamvv/WMsd++Wgh4yOPTYcNqF4h2n9HKyFnUkLHlAT39vyqERd0FkA/V9iQAOz3plaHzunWXG2CpjWOlfexvU95CU029OaXFHopZnWw=="}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:09.185363 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-f54319d9-5233-46c4-bddb-7523f0dc120a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:55:09.208635 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-f54319d9-5233-46c4-bddb-7523f0dc120a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for user c2079b0fbf7b4a8c88d2522da9f2c73b and project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:55:09.399918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f54319d9-5233-46c4-bddb-7523f0dc120a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.558491 Aug 01 16:55:09.400524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 5/14] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 16:55:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:55:09.537263 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-879a99d9-96e0-40d3-8e44-60bc3cebabde tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:09.538228 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-879a99d9-96e0-40d3-8e44-60bc3cebabde tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:09.705626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-879a99d9-96e0-40d3-8e44-60bc3cebabde tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:09.717531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-879a99d9-96e0-40d3-8e44-60bc3cebabde tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1215 microversion: 2.1 time: 0.186054 Aug 01 16:55:09.723659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 10/15] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:09 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:10.027604 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-46d6b925-32b7-4990-a8a1-ef0fefa0982d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733e7c5b80>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:10.087638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-46d6b925-32b7-4990-a8a1-ef0fefa0982d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 288 microversion: 2.1 time: 0.066674 Aug 01 16:55:10.088232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 6/16] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:10 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:10.100133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-74ccf623-85ec-4a5b-8d0e-b768a3ce6b1d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f8e6c10>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:10.414658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-74ccf623-85ec-4a5b-8d0e-b768a3ce6b1d tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 202 len: 0 microversion: 2.1 time: 0.318564 Aug 01 16:55:10.418762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 11/17] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 1 16:55:10 2022] DELETE /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:55:10.425294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6e7561c4-d95b-43e3-b96e-cb2fde360703 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733e7d7280>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:10.582281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6e7561c4-d95b-43e3-b96e-cb2fde360703 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 200 len: 287 microversion: 2.1 time: 0.161558 Aug 01 16:55:10.583583 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 7/18] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:10 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:10.746362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfa1b97c-0ce1-4f3e-8cdb-42ecb9ab2729 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:10.746990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfa1b97c-0ce1-4f3e-8cdb-42ecb9ab2729 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:11.043195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cfa1b97c-0ce1-4f3e-8cdb-42ecb9ab2729 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:11.051757 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfa1b97c-0ce1-4f3e-8cdb-42ecb9ab2729 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1215 microversion: 2.1 time: 0.311301 Aug 01 16:55:11.055327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 12/19] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:10 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:11.320194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1957453006", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:11.487932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] validate_networks() for [('d60261e2-2b1c-4ad0-8e3b-3707f4083506', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:55:11.597492 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e5e0d6e-d9fb-4f91-94b5-a0d458f85654 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f91e5e0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:11.673090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-2e5e0d6e-d9fb-4f91-94b5-a0d458f85654 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] HTTP exception thrown: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e5e0d6e-d9fb-4f91-94b5-a0d458f85654 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Request method failure captured: Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc HTTP/1.1 Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVfz3pyuttw8wyvaEUiu3Q704_pvy2QJvTS-kNmnDCqN5L8eW9YYFRRlUCvqedpe5bJobrtBnvOtIDqc3SeZmD2e1zpvU-Ycau8t4H0MAot077mzC-rEA-z1Mn5UQ98sHMtseX-mT2R9X-Qx7wAumPHdXyFbkJDOFNWvOfJFGSug0I Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 16:55:11.677496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3730f131740e40af8d6d83d7844df33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 3abf76e9664a4723bfbac555c914d50d Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'b40be8fb-4418-4abb-a957-0e134825bfcc'} Aug 01 16:55:11.679289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. (HTTP 404) (Request-ID: req-cc809b2a-e1f7-4bbc-838c-1893cebcc430) Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.680198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:11.681452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 16:55:11.682774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e5e0d6e-d9fb-4f91-94b5-a0d458f85654 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Returning 404 to user: Snapshot b40be8fb-4418-4abb-a957-0e134825bfcc could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:55:11.683978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2e5e0d6e-d9fb-4f91-94b5-a0d458f85654 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc" status: 404 len: 111 microversion: 2.1 time: 0.090166 Aug 01 16:55:11.685882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 13/20] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 1 16:55:11 2022] GET /compute/v2.1/os-snapshots/b40be8fb-4418-4abb-a957-0e134825bfcc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:55:11.709054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-301e52ad-e3fc-485c-b2df-a297ade1b579 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f734028d3a0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:12.123866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-301e52ad-e3fc-485c-b2df-a297ade1b579 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 202 len: 0 microversion: 2.1 time: 0.433965 Aug 01 16:55:12.124860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 14/21] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 16:55:11 2022] DELETE /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:55:12.129953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:12.130947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:12.161030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:12.161487 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:12.162297 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:12.162732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:12.379096 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:55:12.379698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:55:12.380323 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:55:12.380880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:55:12.381467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:55:12.402440 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:12.402952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:12.403680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:12.406942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:12.459338 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:55:12.476208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:12.484917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for user b353fdd302394227987a6ae8c2943173 and project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:55:12.500852 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f1ac69f7-7822-40ee-80bf-f26b3ec7ea65 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1219 microversion: 2.1 time: 0.375083 Aug 01 16:55:12.515179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 15/22] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:12 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1219 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:12.522360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9d073846-57fb-4d4c-bca1-df1384d86592 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f7c6790>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:12.530973 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:55:12.540953 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:55:12.654069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9d073846-57fb-4d4c-bca1-df1384d86592 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 200 len: 344 microversion: 2.1 time: 0.136167 Aug 01 16:55:12.655222 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 16/23] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:55:12 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:12.736493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4d3de365-a634-49ef-9812-56f58e830590 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.879738 Aug 01 16:55:12.737141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 8/24] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:55:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:55:12.749656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fa9adc1a-d3e8-4cbe-81c2-5605c25387a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:12.750776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fa9adc1a-d3e8-4cbe-81c2-5605c25387a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:12.931066 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fa9adc1a-d3e8-4cbe-81c2-5605c25387a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:12.937887 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fa9adc1a-d3e8-4cbe-81c2-5605c25387a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1222 microversion: 2.1 time: 0.192356 Aug 01 16:55:12.941588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 17/25] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:12 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:13.295391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1462439723", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:13.477417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] validate_networks() for [('d60261e2-2b1c-4ad0-8e3b-3707f4083506', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:55:13.524703 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:13.525241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:13.543374 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:13.544181 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:13.544996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:13.545428 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:13.703170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:13.715059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d74fefa8-03a2-40b8-a797-c105a61f542c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1211 microversion: 2.1 time: 0.194410 Aug 01 16:55:13.715983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 18/26] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:13 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1211 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:13.724922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8f560a52-490e-4b18-bd7e-3f6748ca25b6 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f7ce550>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:13.806103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8f560a52-490e-4b18-bd7e-3f6748ca25b6 tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 200 len: 344 microversion: 2.1 time: 0.088562 Aug 01 16:55:13.806725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 19/27] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:55:13 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:14.177103 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:55:14.179345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:55:14.179833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:55:14.180249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:55:14.180667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:55:14.203649 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:14.204410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:14.205571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:14.222264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:14.252787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:55:14.257348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for user b353fdd302394227987a6ae8c2943173 and project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:55:14.282280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:55:14.288586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:55:14.473192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3b41dfe3-b67e-46f1-b6f9-d76c71077f98 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.183126 Aug 01 16:55:14.484915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 9/28] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:55:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:55:14.493774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-05466f41-272f-4e90-a1f6-cbbc38362bdc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:14.495993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-05466f41-272f-4e90-a1f6-cbbc38362bdc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:14.633782 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-05466f41-272f-4e90-a1f6-cbbc38362bdc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:14.657064 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-05466f41-272f-4e90-a1f6-cbbc38362bdc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1222 microversion: 2.1 time: 0.169306 Aug 01 16:55:14.671092 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 20/29] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:14 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:14.737782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:14.738750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:14.778302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:14.779708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:14.780451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:14.782552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:14.824450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3cef832b-255c-4afa-a266-11c01a35a0ed tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733f7f5e50>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:14.933623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3cef832b-255c-4afa-a266-11c01a35a0ed tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 200 len: 344 microversion: 2.1 time: 0.113174 Aug 01 16:55:14.934722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 21/30] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:55:14 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:14.964006 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-226750036", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b45f120b-a0dc-4da7-8661-b8d262f22721"}], "security_groups": [{"name": "tempest-securitygroup--1935390298"}], "key_name": "tempest-keypair-1529675577", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:15.196292 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:15.226903 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0cad2265-5350-4eca-b426-b8242d495c61 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1211 microversion: 2.1 time: 0.493177 Aug 01 16:55:15.227494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 10/31] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:14 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1211 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:15.240432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] validate_networks() for [('b45f120b-a0dc-4da7-8661-b8d262f22721', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:55:15.683198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a17a120d-1049-4d86-86d8-d7689b8447c8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:15.684041 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a17a120d-1049-4d86-86d8-d7689b8447c8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:15.819127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a17a120d-1049-4d86-86d8-d7689b8447c8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:15.841750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a17a120d-1049-4d86-86d8-d7689b8447c8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1222 microversion: 2.1 time: 0.163908 Aug 01 16:55:15.860833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 11/32] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:15 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:15.949380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-648d4213-24d8-4f67-ad0e-f367db8bbfbb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733e7c5a60>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-648d4213-24d8-4f67-ad0e-f367db8bbfbb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] HTTP exception thrown: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-648d4213-24d8-4f67-ad0e-f367db8bbfbb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Request method failure captured: Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 HTTP/1.1 Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVfz3pyuttw8wyvaEUiu3Q704_pvy2QJvTS-kNmnDCqN5L8eW9YYFRRlUCvqedpe5bJobrtBnvOtIDqc3SeZmD2e1zpvU-Ycau8t4H0MAot077mzC-rEA-z1Mn5UQ98sHMtseX-mT2R9X-Qx7wAumPHdXyFbkJDOFNWvOfJFGSug0I Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:55:16.049077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3730f131740e40af8d6d83d7844df33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 3abf76e9664a4723bfbac555c914d50d Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '423a923c-9471-4c83-a49f-19b531c89b81'} Aug 01 16:55:16.050601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. (HTTP 404) (Request-ID: req-0c4cd14d-6d2d-48da-96c1-ef0b44748920) Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.051416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:16.052688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:55:16.053856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-648d4213-24d8-4f67-ad0e-f367db8bbfbb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Returning 404 to user: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-648d4213-24d8-4f67-ad0e-f367db8bbfbb tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 404 len: 109 microversion: 2.1 time: 0.092233 Aug 01 16:55:16.056349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 12/33] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:55:15 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:55:16.059733 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c1fc3bee-e030-41e8-8564-45b920a3bfad tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733de75a60>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:16.104993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-c1fc3bee-e030-41e8-8564-45b920a3bfad tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] HTTP exception thrown: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c1fc3bee-e030-41e8-8564-45b920a3bfad tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Request method failure captured: Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 HTTP/1.1 Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVfz3pyuttw8wyvaEUiu3Q704_pvy2QJvTS-kNmnDCqN5L8eW9YYFRRlUCvqedpe5bJobrtBnvOtIDqc3SeZmD2e1zpvU-Ycau8t4H0MAot077mzC-rEA-z1Mn5UQ98sHMtseX-mT2R9X-Qx7wAumPHdXyFbkJDOFNWvOfJFGSug0I Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:55:16.107269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3730f131740e40af8d6d83d7844df33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 3abf76e9664a4723bfbac555c914d50d Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '423a923c-9471-4c83-a49f-19b531c89b81'} Aug 01 16:55:16.108350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. (HTTP 404) (Request-ID: req-754ef803-acad-4734-851d-8715cf30b251) Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.108984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:55:16.109993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 16:55:16.110988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c1fc3bee-e030-41e8-8564-45b920a3bfad tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Returning 404 to user: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c1fc3bee-e030-41e8-8564-45b920a3bfad tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 404 len: 109 microversion: 2.1 time: 0.053646 Aug 01 16:55:16.111900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 13/34] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 16:55:16 2022] DELETE /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:55:16.123057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-83681342-3c33-4714-9264-818baabc8fab tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Calling method '.version_select at 0x7f733de755e0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:16.168988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-83681342-3c33-4714-9264-818baabc8fab tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] HTTP exception thrown: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-83681342-3c33-4714-9264-818baabc8fab tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Request method failure captured: Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 HTTP/1.1 Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVfz3pyuttw8wyvaEUiu3Q704_pvy2QJvTS-kNmnDCqN5L8eW9YYFRRlUCvqedpe5bJobrtBnvOtIDqc3SeZmD2e1zpvU-Ycau8t4H0MAot077mzC-rEA-z1Mn5UQ98sHMtseX-mT2R9X-Qx7wAumPHdXyFbkJDOFNWvOfJFGSug0I Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:55:16.171043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3730f131740e40af8d6d83d7844df33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3730f131740e40af8d6d83d7844df33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 3730f131740e40af8d6d83d7844df33d Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-314379246 Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 3abf76e9664a4723bfbac555c914d50d Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-314379246-project Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '423a923c-9471-4c83-a49f-19b531c89b81'} Aug 01 16:55:16.172200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. (HTTP 404) (Request-ID: req-4988f00e-2009-4599-8644-310bc522d4f1) Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.172848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:55:16.174412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:55:16.175491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-83681342-3c33-4714-9264-818baabc8fab tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] Returning 404 to user: Volume 423a923c-9471-4c83-a49f-19b531c89b81 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-83681342-3c33-4714-9264-818baabc8fab tempest-VolumesSnapshotsTestJSON-314379246 tempest-VolumesSnapshotsTestJSON-314379246-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81" status: 404 len: 109 microversion: 2.1 time: 0.055331 Aug 01 16:55:16.177275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 14/35] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 16:55:16 2022] GET /compute/v2.1/os-volumes/423a923c-9471-4c83-a49f-19b531c89b81 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:55:16.248742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:16.251030 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:16.259766 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:16.263319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:16.264988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:16.265434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:16.388692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:16.404399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6f5a5763-0ea6-490b-bb87-e5b167ffd77c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1275 microversion: 2.1 time: 0.160598 Aug 01 16:55:16.405364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 15/36] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:16 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:16.887777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:16.888760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:16.910872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:16.911553 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:16.912869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:16.913502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:17.478378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:17.494162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-785fd649-d131-4625-aaa5-7e751014b2fa tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1274 microversion: 2.1 time: 0.607415 Aug 01 16:55:17.496571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 16/37] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:16 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1274 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:17.522194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:17.522866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:17.532452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:17.533231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:17.534759 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:17.535825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:17.781367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:17.798443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-eae7a73c-cd45-49be-8a87-c01e4c14f2f7 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1273 microversion: 2.1 time: 0.280081 Aug 01 16:55:17.800135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 17/38] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:17 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:18.091825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:55:18.093097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:55:18.093817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:55:18.094531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:55:18.095307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:55:18.113863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.114668 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.115943 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.116598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.178488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:55:18.186578 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for user c2079b0fbf7b4a8c88d2522da9f2c73b and project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:55:18.201519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:55:18.204629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:55:18.401692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5345c275-6327-44e4-8853-d34e2fc28de2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.442546 Aug 01 16:55:18.408560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 22/39] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:55:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:55:18.417714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-73836e4f-9877-4799-baa3-99568db24396 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:18.419398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-73836e4f-9877-4799-baa3-99568db24396 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:18.515963 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-73836e4f-9877-4799-baa3-99568db24396 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:18.521317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:18.522248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:18.528469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-73836e4f-9877-4799-baa3-99568db24396 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1237 microversion: 2.1 time: 0.118534 Aug 01 16:55:18.529606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 18/40] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:18 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:18.545530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.545980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.549206 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.549660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.821045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:18.821693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:18.834317 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.842488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.847942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:18.850291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:18.876163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:18.887050 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b530dd2d-f013-407a-bde8-9f1f2ed7b197 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1280 microversion: 2.1 time: 0.367412 Aug 01 16:55:18.888955 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 23/41] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:18 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:19.074656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:19.083360 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-477d4751-f6bc-483b-8610-e6e2afaa7963 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1273 microversion: 2.1 time: 0.266296 Aug 01 16:55:19.118507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:18 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:19.553134 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8b5e643a-baad-4d2f-88f1-9bf1c9189f00 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:19.553742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8b5e643a-baad-4d2f-88f1-9bf1c9189f00 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:19.861167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b5e643a-baad-4d2f-88f1-9bf1c9189f00 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:19.895184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8b5e643a-baad-4d2f-88f1-9bf1c9189f00 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1237 microversion: 2.1 time: 0.345678 Aug 01 16:55:19.897904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:19 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1237 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:19.913993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:19.915250 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:19.924207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:19.929760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:19.937342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:19.938460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:20.109861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:20.110741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:20.132907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:20.133654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:20.135927 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:20.140058 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:20.232909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:20.242800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9a30a26d-b82b-48ed-bfb1-9c9dd85e8205 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1280 microversion: 2.1 time: 0.335438 Aug 01 16:55:20.250806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 20/44] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:19 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1280 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:20.922571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:20.924027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:20.936378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:20.937069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:20.944025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:20.944025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:20.985053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:20.999120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9fc46b2b-5199-489b-b5ea-c38c8cb5f912 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.889434 Aug 01 16:55:21.012306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 25/45] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:20 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:21.274490 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:21.275214 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:21.300123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:21.304304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:21.312078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:21.312965 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:21.384534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:21.401240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b8f33b06-7b2a-4af2-ab32-89449e637340 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1241 microversion: 2.1 time: 0.483473 Aug 01 16:55:21.402022 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 21/46] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:20 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1241 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:22.011538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:22.021086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f6710a63-3eb0-4af4-b474-5ec6a66a66b8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.752137 Aug 01 16:55:22.024893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:22.028784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:22.040916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:22.041215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:21 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:22.043970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:22.045017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:22.046128 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:22.424500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:22.425376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:22.435466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:22.436131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:22.437071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:22.437521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:22.596625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:22.607912 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4782def3-5a49-40ab-b4a5-ed70dcd491d3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.589884 Aug 01 16:55:22.620645 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:22 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:22.627512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:22.635719 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7f556903-7a1c-42a4-a9b8-10baaf130705 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.216017 Aug 01 16:55:22.649411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 27/49] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:22 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:23.045717 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:23.046763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:23.059693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.060698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.061748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.062524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.294872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:23.312588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f4fa1e67-be79-4c6d-9741-7cc0d50834b5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.269133 Aug 01 16:55:23.324493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 23/50] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:23 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:23.650554 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:23.656656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:23.661054 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.661872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.662900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.663478 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.671718 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-3d33a2a6-82b0-45f6-b035-bf395f030c48 req-05e3b126-4687-48eb-b61e-3811eff6ec4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27932a15-1227-4a4d-9d0a-11f8acddde3d", "tag": "e5d91718-9dfb-4cfd-8f3b-edc873c093f3"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:23.696227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3d33a2a6-82b0-45f6-b035-bf395f030c48 req-05e3b126-4687-48eb-b61e-3811eff6ec4b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.698550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3d33a2a6-82b0-45f6-b035-bf395f030c48 req-05e3b126-4687-48eb-b61e-3811eff6ec4b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.727190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-3d33a2a6-82b0-45f6-b035-bf395f030c48 req-05e3b126-4687-48eb-b61e-3811eff6ec4b service nova] Creating event network-changed:e5d91718-9dfb-4cfd-8f3b-edc873c093f3 for instance 27932a15-1227-4a4d-9d0a-11f8acddde3d on hv-cinder-84989 Aug 01 16:55:23.727746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3d33a2a6-82b0-45f6-b035-bf395f030c48 req-05e3b126-4687-48eb-b61e-3811eff6ec4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 16:55:23.729043 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.729784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.730612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.731047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.740329 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.compute.rpcapi [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 16:55:23.746285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] Releasing lock "compute-rpcapi-router" {{(pid=124837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 16:55:23.758779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e431e6a0-34a9-42c4-8695-8b860ae456fb None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459798 Aug 01 16:55:23.759381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 28/51] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:55:23.765262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:23.765958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:23.772126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.772797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.773414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:23.773846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:23.851241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:23.860101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e30a3619-04c8-41f5-ab7f-a87434f0af36 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.098651 Aug 01 16:55:23.874878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:23 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:23.883737 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:23.910673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-67c56e39-0cd1-4a94-bfa2-834bcfb9f296 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.252167 Aug 01 16:55:23.911803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 24/53] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:23 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:24.241024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-9e3b67ae-5a62-4c6c-943e-8cdc743fb180 req-da3654c2-06f4-4ca3-8cb9-8352be47a177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a14f063-efef-44ab-b5a4-9db169f84795", "tag": "efe95d66-61db-4eb5-857f-50a23fb3edc4"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:24.251616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-9e3b67ae-5a62-4c6c-943e-8cdc743fb180 req-da3654c2-06f4-4ca3-8cb9-8352be47a177 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.252282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-9e3b67ae-5a62-4c6c-943e-8cdc743fb180 req-da3654c2-06f4-4ca3-8cb9-8352be47a177 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.264894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-9e3b67ae-5a62-4c6c-943e-8cdc743fb180 req-da3654c2-06f4-4ca3-8cb9-8352be47a177 service nova] Creating event network-changed:efe95d66-61db-4eb5-857f-50a23fb3edc4 for instance 0a14f063-efef-44ab-b5a4-9db169f84795 on hv-cinder-84989 Aug 01 16:55:24.270551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-9e3b67ae-5a62-4c6c-943e-8cdc743fb180 req-da3654c2-06f4-4ca3-8cb9-8352be47a177 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308638 Aug 01 16:55:24.271682 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 30/54] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:24.333369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:24.334052 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:24.337192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:24.342379 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.342836 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.343801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.344863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.524891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:24.535316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c3840413-0598-44c4-9dc6-75160a6c5171 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.205931 Aug 01 16:55:24.549501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:24 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:24.882054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:24.882755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:24.889616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.890085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.890840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.891311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.934551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:24.935164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:24.966199 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.967059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.971492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:24.971492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:24.974230 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:24.982601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c344fb60-426a-4e80-8143-2c699161ec2e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.104735 Aug 01 16:55:24.984290 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 31/56] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:24 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:25.162135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:25.170589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b61cfbe8-9650-43f8-a3ac-bd61556ab1a4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.242498 Aug 01 16:55:25.171175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:24 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:25.564708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:25.566284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:25.582229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:25.582768 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:25.583638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:25.585294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:25.796473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:25.804138 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b302b29f-4b86-4e24-a4d8-67f84414f45a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.250810 Aug 01 16:55:25.804793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 32/58] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:25 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:26.018194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:26.018874 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:26.025111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.025816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.026917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.027537 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.102504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:26.112229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-899160ed-c584-40bb-b732-71d417bcdf5d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.098599 Aug 01 16:55:26.113306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:26 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:26.193560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:26.194950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:26.203736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.204342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.205546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.206500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.312933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-720adbd6-4326-424a-b7a7-0ef806e153dd req-a09de90c-adbe-414f-a279-54d31bf493fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0921a70d-6912-4400-858b-2af63cf43e11", "tag": "f74d95b4-ded1-42a4-8000-2ae76b64e736"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:26.331319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-720adbd6-4326-424a-b7a7-0ef806e153dd req-a09de90c-adbe-414f-a279-54d31bf493fd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.331992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-720adbd6-4326-424a-b7a7-0ef806e153dd req-a09de90c-adbe-414f-a279-54d31bf493fd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.355384 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-720adbd6-4326-424a-b7a7-0ef806e153dd req-a09de90c-adbe-414f-a279-54d31bf493fd service nova] Creating event network-changed:f74d95b4-ded1-42a4-8000-2ae76b64e736 for instance 0921a70d-6912-4400-858b-2af63cf43e11 on hv-cinder-84989 Aug 01 16:55:26.355909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-720adbd6-4326-424a-b7a7-0ef806e153dd req-a09de90c-adbe-414f-a279-54d31bf493fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 16:55:26.357223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.357664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.358467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.358894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.372221 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.compute.rpcapi [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 16:55:26.373392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] Releasing lock "compute-rpcapi-router" {{(pid=124835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 16:55:26.389720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1c1579d2-3089-441f-af3c-ecda7e1bcf68 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080532 Aug 01 16:55:26.390873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 28/60] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:26.605139 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:26.622495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b7f508bb-2297-4486-a36e-6bc03b4cf77a tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.434526 Aug 01 16:55:26.640033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 33/61] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:26 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:26.829154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:26.830376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:26.848245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.848245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:26.848245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:26.848245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:27.147765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:27.153202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:27.153915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:27.170339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1e89269c-a905-40fc-9fe1-54ce44a7a885 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.341945 Aug 01 16:55:27.170339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 29/62] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:26 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:27.172462 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:27.172962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:27.173771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:27.174251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:27.319121 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:27.336595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2cb2b84e-7cea-448c-a0d9-6c097b43b706 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.198720 Aug 01 16:55:27.338690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 34/63] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:27 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:27.648505 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:27.649486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:27.653886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:27.659981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:27.660429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:27.661415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:27.661844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:27.878921 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:27.883392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:27.891012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6b4e71ce-e693-4655-bb1c-039bbddc25d2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.245531 Aug 01 16:55:27.891012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:27 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:28.199304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:28.200199 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:28.216669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.220157 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:28.221237 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.221774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:28.359396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:28.360141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:28.367122 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.367832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:28.369664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.370365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:28.395374 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:28.410067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e03e5d53-0957-487c-8dab-1f43f785f1f2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.216024 Aug 01 16:55:28.410691 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 35/65] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:28 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:28.445807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:28.453750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b1b6dfaa-f0ba-423c-aed1-4b026b1732ef tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.098576 Aug 01 16:55:28.454374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 31/66] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:28 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:28.917405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:28.918912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:28.945184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.945508 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:28.949449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:28.953860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:29.254942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:29.264192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9bdf3161-e95c-43b4-aa3b-aa33423f1326 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.352424 Aug 01 16:55:29.279218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 36/67] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:28 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:29.433296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:29.434348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:29.437166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=26 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:29.442688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:29.443443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:29.444842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:29.445481 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:29.479212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:29.480730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:29.491387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:29.492285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:29.496549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:29.497913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:29.633383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:29.644114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0cfa2db0-a87e-4353-84e0-f1c5b4d2e52a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.170743 Aug 01 16:55:29.646433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 37/68] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:29 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:29.713388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:29.735665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-daf09ae0-6117-4941-a4ae-8df543096c22 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.307074 Aug 01 16:55:29.736418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 32/69] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:29 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:30.285761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:30.286442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:30.290425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=18 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:30.301207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.302256 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.305124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.306629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.558948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:30.572630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3e2617ac-4502-47a1-bbd3-c77cfd9f9051 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.291488 Aug 01 16:55:30.573803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 38/70] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:30 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:30.671099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:30.672557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:30.690470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.708861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.713814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.717773 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.757100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:30.757751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:30.770372 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.774684 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.781014 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:30.781551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:30.797063 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:30.877144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:30.899705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d9549b14-fac9-47ab-92c9-0a25efb851ea tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1297 microversion: 2.1 time: 0.227879 Aug 01 16:55:30.916624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:30 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1297 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:31.332667 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:31.341722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ed3b6864-7bb6-418a-8f2a-4b9d4f002a81 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.588492 Aug 01 16:55:31.342505 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 39/72] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:30 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:31.597388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:31.598221 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:31.609321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:31.609999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:31.612841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:31.615832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:31.923143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:31.923752 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:31.925049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:31.930069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:31.933602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:31.933602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:31.933602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:31.933922 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8dccfeec-99a3-4ad7-be00-32cf9cda9490 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.340141 Aug 01 16:55:31.940560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 34/73] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:31 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:32.016248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:32.026060 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cebba35c-eca8-4bfc-9149-d582145c42bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.106709 Aug 01 16:55:32.027086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 40/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:31 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:32.363093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:32.363984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:32.371823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:32.372748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:32.373705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:32.374427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:32.609339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:32.618216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9a8f1386-cb48-4e8c-89c8-8eab486075ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.259207 Aug 01 16:55:32.620417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 35/75] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:32 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:32.959134 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:32.960295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:32.970660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:32.971283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:32.972255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:32.973110 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:33.055071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:33.055600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:33.063207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:33.063695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:33.064854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:33.065554 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:33.135752 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:33.147680 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4ab3df69-0cef-4947-8cee-1c877f7ed11f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.196934 Aug 01 16:55:33.148663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 41/76] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:32 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:33.157695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:33.166213 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0754acdf-db69-41d7-bea6-8d1f22d51af1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.114900 Aug 01 16:55:33.168095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 36/77] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:33 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:33.641556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:33.645141 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:33.659858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:33.660317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:33.661113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:33.661572 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:33.739014 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:33.828213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:33.836569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-45e58276-cccf-4da3-8745-70e4b5ab357c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.198843 Aug 01 16:55:33.837147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 42/78] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:33 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:34.169990 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:34.170629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:34.176540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.176989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:34.177743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.178208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:34.187018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:34.187882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:34.194368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.194894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:34.195791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.196231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:34.260987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:34.268410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3994d937-d72a-4c5f-ac7d-1ff87500acda tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.085560 Aug 01 16:55:34.269035 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 43/79] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:34 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:34.312254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:34.320519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-30fe94df-e9b3-45dd-940a-cd83285a783d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.154754 Aug 01 16:55:34.321083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 37/80] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:34 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:34.856713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:34.857442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:34.867419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.867419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:34.867419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:34.867696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:35.033746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:35.076249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-14784ec7-bd97-4b3a-9b49-4aa5f14eda48 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.188808 Aug 01 16:55:35.076249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 44/81] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:34 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:35.288626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:35.289240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:35.295392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:35.295828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:35.296586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:35.297019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:35.345227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:35.346622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:35.352937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:35.353405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:35.354363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:35.357623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:35.359014 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:35.366523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-315cb7c6-62c8-4b81-bd6c-580a480f39e9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.081668 Aug 01 16:55:35.367102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 38/82] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:35 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:35.491821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:35.503440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ce66f2d-d425-4e3d-96df-3858f23448cf tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.162391 Aug 01 16:55:35.504023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 45/83] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:35 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:36.089857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:36.090551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:36.097103 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.097550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.104445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.104445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.247172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:36.255839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dacfe714-ca53-4743-b61c-6d96cab87c51 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.171137 Aug 01 16:55:36.256499 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 39/84] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:36 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:36.387119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:36.387765 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:36.389639 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:36.394304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.394908 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.395522 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.395958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.457317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:36.465405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f8cc6f50-1030-4166-bb44-268ff1318b23 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.082366 Aug 01 16:55:36.468169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 46/85] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:36 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:36.527506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:36.528576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:36.530549 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:36.536356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.536883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.537879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:36.538488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:36.981144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:36.992219 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cd02f8b4-9006-4399-8382-be3a8cdc39a2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.469514 Aug 01 16:55:36.995261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 40/86] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:36 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:37.277895 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:37.278537 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:37.296376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:37.296376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:37.296376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:37.296908 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:37.485671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:37.486322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:37.501570 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:37.502024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:37.503020 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:37.503601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:37.630393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:37.642367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-08a39165-8826-4d8a-9873-cfea5f468b40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1295 microversion: 2.1 time: 0.160511 Aug 01 16:55:37.644461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 41/87] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:37 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:37.784665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:37.793861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-383c2344-2ff0-42ef-8b0f-2b8c2ce55855 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.520313 Aug 01 16:55:37.794560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 47/88] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:37 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:38.016900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:38.017867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:38.028264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.033208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.033208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.033208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.264463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:38.275665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b6aec787-255a-418f-9328-8a5cb7615d3e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.260433 Aug 01 16:55:38.278585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 42/89] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:38 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:38.664982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:38.666328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:38.676188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.676631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.677472 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.677915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.816829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:38.817614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:38.824512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.825015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.825857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:38.826392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:38.844707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:38.852482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59f0cb2e-ae30-4ef1-9a80-13b691a931e0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.191602 Aug 01 16:55:38.853726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 48/90] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:38 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:38.961928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:38.970764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b10c551f-9dc1-480f-bc08-8471efebed02 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.158489 Aug 01 16:55:38.971345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 43/91] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:38 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:39.298323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:39.298937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:39.307457 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:39.307919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:39.308698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:39.309134 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:39.475070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:39.482717 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf6cdb39-4009-45a6-9c5e-19f6c6fa859b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.188278 Aug 01 16:55:39.483287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:39 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:39.875097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:39.875896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:39.890003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:39.890483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:39.891261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:39.892365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:39.992292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:39.992911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:39.999858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:40.000416 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:40.001195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:40.001631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:40.080789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:40.089722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2deffc85-ea91-4815-aadb-db539fdddd29 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.218554 Aug 01 16:55:40.090596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 44/93] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:39 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:40.164769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:40.172432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-13cb06ff-f633-42d4-be09-0ee34f9c3dee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.184402 Aug 01 16:55:40.173557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 50/94] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:39 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:40.519615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:40.521143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:40.533860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:40.534525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:40.535481 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:40.536918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:40.720737 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:40.735851 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6c8572f0-9f38-4afd-8bd5-59d98a19dcb6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.229410 Aug 01 16:55:40.737038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 45/95] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:40 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:41.113759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:41.115673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:41.126098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.127019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.127999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.128619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.195552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:41.197227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:41.221576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.222231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.223861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.224501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.578980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:41.587995 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6183836-88bb-4478-beed-10e0e4dfd055 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.397385 Aug 01 16:55:41.588607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 46/96] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:41 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:41.653328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:41.660661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-aa117c61-1f05-4574-88a3-4bc4e973ee31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.551827 Aug 01 16:55:41.661449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 51/97] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:41 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:41.760839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:41.761680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:41.768112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.768819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.769788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:41.771096 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:41.795193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:41.928986 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:41.936339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-620fe8b3-77d1-46e2-91ab-159b538e660c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.179423 Aug 01 16:55:41.936975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 47/98] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:41 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:42.351401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-2a0ebd95-96a0-491c-ad0d-1ac21b4829bf req-c77b1a96-6d3b-4aca-a4d6-25acfc9525f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac7cea8-b1f2-4104-bb3b-083dcacbf502", "tag": "e12e7e64-d495-4d63-b74b-0480b5df984e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:42.368408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2a0ebd95-96a0-491c-ad0d-1ac21b4829bf req-c77b1a96-6d3b-4aca-a4d6-25acfc9525f0 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.370362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2a0ebd95-96a0-491c-ad0d-1ac21b4829bf req-c77b1a96-6d3b-4aca-a4d6-25acfc9525f0 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.389510 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-2a0ebd95-96a0-491c-ad0d-1ac21b4829bf req-c77b1a96-6d3b-4aca-a4d6-25acfc9525f0 service nova] Creating event network-changed:e12e7e64-d495-4d63-b74b-0480b5df984e for instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 on hv-cinder-84989 Aug 01 16:55:42.398688 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-2a0ebd95-96a0-491c-ad0d-1ac21b4829bf req-c77b1a96-6d3b-4aca-a4d6-25acfc9525f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050010 Aug 01 16:55:42.400776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 52/99] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:42.608568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:42.609282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:42.616189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.616914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.617682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.618190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.682244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:42.682862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:42.689040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.701661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.701661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.701661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.753215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:42.762864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bed40ec2-bbb4-4c3f-8721-4ca9a9355e79 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.158131 Aug 01 16:55:42.763749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:42 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:42.829203 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:42.836648 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de48473d-6df6-4f0f-a2a8-98186c7e35e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.158657 Aug 01 16:55:42.837217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 53/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:42 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:42.956658 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:42.957298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:42.967227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.967847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:42.968623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:42.969059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:43.108865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:43.117427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-349606ac-549a-46f7-bda0-33aa84f6be5c tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.164608 Aug 01 16:55:43.121490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 49/102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:42 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:43.784995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:43.785678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:43.792095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:43.792541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:43.793297 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:43.793728 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:43.861568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:43.862362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:43.869582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:43.870206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:43.871064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:43.871569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:43.940939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:43.949867 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f357e87d-2789-4530-9033-d8509160a358 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.168734 Aug 01 16:55:43.950489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 54/103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:43 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:44.004103 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:44.012401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dd89e3de-d064-4207-8084-57202c665ddb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.158268 Aug 01 16:55:44.012997 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 50/104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:43 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:44.140003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:44.142164 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:44.146623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:44.147071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:44.147844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:44.148311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:44.284243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:44.297098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e5d74d9c-9944-4e74-a785-88b494a6de8e tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.157061 Aug 01 16:55:44.297098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:44 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:44.971091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:44.971710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:44.977803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:44.978927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:44.979550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:44.979981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:45.033989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:45.034715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:45.042065 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:45.042743 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:45.043657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:45.044152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:45.063779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:45.123974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:45.131643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f664915b-9115-4ff0-8818-d8a06951f29d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.164324 Aug 01 16:55:45.132221 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 51/106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:44 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:45.175643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:45.183529 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c34940b1-e920-4663-bc63-b85dd4980ccc tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.154130 Aug 01 16:55:45.184101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 56/107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:45 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:45.314493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:45.315090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:45.321199 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:45.322227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:45.322996 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:45.323433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:45.473909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:45.482056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e1471b81-9639-46b1-9259-f897da0a52ac tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.171344 Aug 01 16:55:45.482725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:45 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:46.152988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:46.153589 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:46.159744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.160186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.161052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.161550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.204143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:46.204757 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:46.210849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.211311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.212077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.212727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.335315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:46.343944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-83ea37be-b637-43c0-a0e8-7ca92a1a6812 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.194913 Aug 01 16:55:46.345086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 57/109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:46 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:46.385907 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:46.394414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7a164a18-ace7-4fc9-9aca-22aaeb0049fb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.194080 Aug 01 16:55:46.395173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 53/110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:46 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:46.504657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:46.505273 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:46.512837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.513952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.515777 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:46.515777 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:46.660551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:46.668149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfacba5c-6e56-428a-ab6f-bed1ce785b28 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.167991 Aug 01 16:55:46.668837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 58/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:46 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:47.369617 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:47.370249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:47.376454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.376911 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.377833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.378288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.416886 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:47.419868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:47.426357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.426806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.427569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.427994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.542083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:47.557690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-09a8f669-5c47-43d6-9a5b-47465a6f22da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.192285 Aug 01 16:55:47.558721 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:47 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:47.602267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:47.609858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ba39b7e3-c09e-483c-a577-85743ea4c81c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.197470 Aug 01 16:55:47.610470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:47 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:47.690413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:47.691264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:47.698390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.699033 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.699801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:47.700302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:47.852636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:47.860358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1d15ccc7-02f9-4b63-8b60-4f490b91505d tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.175369 Aug 01 16:55:47.861043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 55/114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:47 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:48.577774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:48.578411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:48.584381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.584816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:48.585658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.586290 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:48.631123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:48.631664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:48.638610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.639064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:48.639841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.640276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:48.723692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:48.732767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-791fad69-a1c3-401f-8be8-e3983e5c3ab1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.158206 Aug 01 16:55:48.732767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:48 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:48.774395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:48.782286 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b9526180-126b-430d-9606-9d585752241c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.154918 Aug 01 16:55:48.782972 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 56/116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:48 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:48.883819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:48.884648 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:48.891043 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.891497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:48.892260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:48.892861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:49.023209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:49.031103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9f39049e-986d-4078-ba8b-8c9ded0b7486 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.150998 Aug 01 16:55:49.031676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:48 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:49.754101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:49.754920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:49.761868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:49.762339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:49.763107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:49.763672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:49.803871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:49.804648 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:49.813756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:49.814246 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:49.815207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:49.815645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:49.909826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:49.918263 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b39e3c94-57f8-48b1-95ec-395cdc1935f5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.168418 Aug 01 16:55:49.926074 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:49 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:49.980885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:49.989289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5e0c6b6f-2493-4330-b6a3-b11f0c7446b4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.189555 Aug 01 16:55:49.989863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:49 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:50.052531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:50.053196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:50.059916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:50.060364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:50.061124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:50.061556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:50.188193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:50.195501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7fcf3581-5ca6-4f03-933c-877ffef5b043 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.146842 Aug 01 16:55:50.196057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:50 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:50.938768 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:50.939383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:50.945335 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:50.945821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:50.947247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:50.947775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:51.011766 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:51.012381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:51.018433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:51.018882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:51.019662 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:51.020099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:51.079009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:51.088687 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dd0f38e0-9957-49eb-a7a9-6cfb8882823d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.153745 Aug 01 16:55:51.089489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 63/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:50 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:51.151938 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:51.159370 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-02d4e25a-088f-4c6e-8397-6d13a00f3a67 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.152172 Aug 01 16:55:51.159992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 59/122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:51 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:51.217393 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:51.218008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:51.224122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:51.224572 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:51.225339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:51.225774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:51.353954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:51.361482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-68a096bd-620c-492f-aa8d-421725bb1e70 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.148079 Aug 01 16:55:51.362062 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:51 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:52.045683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-536ade6d-1f87-4b3a-a322-b02c23fdfd39 req-0614e203-6220-4633-8318-9c5201650c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27932a15-1227-4a4d-9d0a-11f8acddde3d", "name": "network-vif-plugged", "status": "completed", "tag": "e5d91718-9dfb-4cfd-8f3b-edc873c093f3"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:52.055093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-536ade6d-1f87-4b3a-a322-b02c23fdfd39 req-0614e203-6220-4633-8318-9c5201650c0a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.055536 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-536ade6d-1f87-4b3a-a322-b02c23fdfd39 req-0614e203-6220-4633-8318-9c5201650c0a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.067051 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-536ade6d-1f87-4b3a-a322-b02c23fdfd39 req-0614e203-6220-4633-8318-9c5201650c0a service nova] Creating event network-vif-plugged:e5d91718-9dfb-4cfd-8f3b-edc873c093f3 for instance 27932a15-1227-4a4d-9d0a-11f8acddde3d on hv-cinder-84989 Aug 01 16:55:52.072277 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-536ade6d-1f87-4b3a-a322-b02c23fdfd39 req-0614e203-6220-4633-8318-9c5201650c0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089530 Aug 01 16:55:52.072885 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 60/124] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:52.109456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:52.110860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:52.117662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.118231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.119340 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.119838 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.181236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:52.182024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:52.188226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.188671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.189431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.189866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.251183 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:52.258581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-88d080c8-4bcf-4a43-a970-73041ab400df tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.153254 Aug 01 16:55:52.261716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 65/125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:52 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:52.322896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:52.330153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-71192f19-fc77-4df2-8f26-7f9f0d532fcb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.153161 Aug 01 16:55:52.330791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 61/126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:52 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:52.383133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:52.383677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:52.390538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.391015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.391779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:52.392215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:52.517626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:52.525742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e21ce2fb-18d6-485d-8cdf-eecb6ae6123b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.146505 Aug 01 16:55:52.526348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:52 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:53.281410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:53.282075 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:53.288181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.288631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.289392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.289831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.351486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:53.355100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:53.358522 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.359047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.359912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.360477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.421005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:53.428372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4ce5415c-231e-4580-b383-7ec6e0b79aa4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.150846 Aug 01 16:55:53.428940 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 62/128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:53 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:53.492769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:53.500955 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6ef178ef-4b74-433a-bee2-0824a0b91061 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.153544 Aug 01 16:55:53.501527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 67/129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:53 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:53.546271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:53.546888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:53.552796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.553245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.554000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:53.554461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:53.927336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:53.947216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4c8a97ae-0cdd-493d-a068-71dbd0b796f6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.403844 Aug 01 16:55:53.960963 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 63/130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:53 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:54.449262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:54.449875 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:54.455877 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.456745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:54.457184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.457615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:54.521504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:54.522154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:54.529980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.530822 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:54.531835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.532874 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:54.609585 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:54.619498 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cc7e5596-4e36-45d3-9fac-0272ad781b1b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.174538 Aug 01 16:55:54.620130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:54 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:54.677358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:54.681494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:54.685780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9ec7c959-6aa0-4e2d-8150-c871717c6c2b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.168259 Aug 01 16:55:54.686391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 64/132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:54 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:54.968312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:54.968929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:54.974959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.975407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:54.976162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:54.976635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.113753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:55.121831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-64e188a3-8aea-447e-930c-3d56841c95f0 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.157387 Aug 01 16:55:55.122425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 69/133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:54 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:55.640086 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:55.640708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:55.650589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:55.651042 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.651815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:55.652251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.707480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:55.708188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:55.716196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:55.718359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.719225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:55.719905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.817142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:55.825222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-80ec3974-2fd7-4d6a-990b-be3a70fd50e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.189257 Aug 01 16:55:55.826451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 65/134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:55 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:55.887826 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:55.897851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7daf62e0-2aaa-4a19-9bce-aa741506fb40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.193647 Aug 01 16:55:55.899212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 70/135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:55 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:55.925627 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-a0f4bd37-c665-42dc-810a-769ef272acea req-1806e01a-238b-485e-ac04-9100550b117e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a14f063-efef-44ab-b5a4-9db169f84795", "name": "network-vif-plugged", "status": "completed", "tag": "efe95d66-61db-4eb5-857f-50a23fb3edc4"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:55:55.938417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-a0f4bd37-c665-42dc-810a-769ef272acea req-1806e01a-238b-485e-ac04-9100550b117e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:55.939117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-a0f4bd37-c665-42dc-810a-769ef272acea req-1806e01a-238b-485e-ac04-9100550b117e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:55.952197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-a0f4bd37-c665-42dc-810a-769ef272acea req-1806e01a-238b-485e-ac04-9100550b117e service nova] Creating event network-vif-plugged:efe95d66-61db-4eb5-857f-50a23fb3edc4 for instance 0a14f063-efef-44ab-b5a4-9db169f84795 on hv-cinder-84989 Aug 01 16:55:55.957186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-a0f4bd37-c665-42dc-810a-769ef272acea req-1806e01a-238b-485e-ac04-9100550b117e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036029 Aug 01 16:55:55.957844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 66/136] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:55:56.142709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:56.143368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:56.149842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.150355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:56.151241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.151670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:56.305055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:56.313430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-702c951a-65e6-4279-b908-15e681c464ce tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.174437 Aug 01 16:55:56.314020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:56 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:56.846794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:56.847494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:56.854400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.855246 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:56.856019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.856503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:56.921069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:56.921440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:56.927530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.927973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:56.928717 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:56.929141 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:57.004263 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:57.010349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-63b5cd21-ee41-4b8b-a11e-f5ca37ea1f50 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.167758 Aug 01 16:55:57.012355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:56 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:57.089640 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:57.098440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9f6171a2-8bca-495d-8949-5ccc8f5a7eac tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.181340 Aug 01 16:55:57.099098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:56 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:57.334649 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:57.335261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:57.341954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:57.342430 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:57.343188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:57.343620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:57.469028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:57.476293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fd20eca8-3bf1-4531-8ec1-286824e0251b tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.145489 Aug 01 16:55:57.476841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:57 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:58.031378 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:58.032108 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:58.038266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.038711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.039506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.040468 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.044556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:58.119840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:58.120451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:58.126493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.126941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.127702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.128134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.169553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:58.176831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8fb9bca6-c8dd-4271-916c-c24d12188963 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.149370 Aug 01 16:55:58.177398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:58 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:58.255542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:58.263623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c851a888-e326-4859-a8af-e0cb6d906314 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.148331 Aug 01 16:55:58.264195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 69/142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:58 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:55:58.497536 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:58.498170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:58.504080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.504521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.505273 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:58.505700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:58.637218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:58.645536 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c1bae54c-7ce1-4d9a-b215-735b72103996 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.152667 Aug 01 16:55:58.646239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:58 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:59.198883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:59.199489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:59.205469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.205915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.206687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.207114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.283884 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:59.284483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:59.290383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.291520 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.292438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.292863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.338009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:59.345362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7309d03c-7c3d-4f2f-b80b-f176d38a3926 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.150915 Aug 01 16:55:59.345933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 70/144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:59 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:59.419431 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:59.426785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7607065b-2fbf-46f3-b995-8d361300bf31 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.146611 Aug 01 16:55:59.427352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 75/145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:59 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:55:59.666818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:55:59.667423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:55:59.669350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=81 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:59.674014 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.674486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.675241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:55:59.675672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:55:59.803863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:55:59.811415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7d70d362-7dfc-4b8b-95ce-16cd4494a5f4 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.149014 Aug 01 16:55:59.811979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 71/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:55:59 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:00.367010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:00.367625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:00.374855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.375305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.376082 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.376561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.448038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:00.448657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:00.455027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.456188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.457313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.457753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.510373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:00.523425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fa4ae17c-eb7a-4831-ba14-e06532bf3564 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.160233 Aug 01 16:56:00.524190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 76/147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:00 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:00.594746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:00.602198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-16d1006c-1d11-4280-848c-be600fdac846 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.158741 Aug 01 16:56:00.602765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 72/148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:00 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:00.832308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:00.832953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:00.839753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.840215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.840974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:00.841464 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:00.972445 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:00.979985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-38bc0058-de97-4267-b339-a06c48497177 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.151481 Aug 01 16:56:00.980549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 77/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:00 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:01.545964 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:01.546624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:01.552979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:01.553428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:01.554220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:01.554654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:01.624679 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:01.625383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:01.631404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:01.631862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:01.632610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:01.633039 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:01.808566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:01.816509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-92a08385-ce6b-4bbd-8ac6-9cdd5d7b8e00 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.274393 Aug 01 16:56:01.817472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 73/150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:01 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:01.940552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:01.948147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1f7e23af-ecbf-4ec9-a100-2794f66038ec tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.327376 Aug 01 16:56:01.948715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 78/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:01 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:02.000819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:02.001405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:02.007407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.012207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.012207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.012207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.143588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:02.151142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f31b97cf-7070-40f4-b91c-2c28d0f1f6e6 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.154261 Aug 01 16:56:02.151761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 74/152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:01 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:02.645332 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-cb5c3ef8-08a5-4a1c-8df4-d1c03643c61e req-f3408414-4942-457a-9729-8d18526b77cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0921a70d-6912-4400-858b-2af63cf43e11", "name": "network-vif-plugged", "status": "completed", "tag": "f74d95b4-ded1-42a4-8000-2ae76b64e736"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:02.655863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-cb5c3ef8-08a5-4a1c-8df4-d1c03643c61e req-f3408414-4942-457a-9729-8d18526b77cd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.656308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-cb5c3ef8-08a5-4a1c-8df4-d1c03643c61e req-f3408414-4942-457a-9729-8d18526b77cd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.668270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-cb5c3ef8-08a5-4a1c-8df4-d1c03643c61e req-f3408414-4942-457a-9729-8d18526b77cd service nova] Creating event network-vif-plugged:f74d95b4-ded1-42a4-8000-2ae76b64e736 for instance 0921a70d-6912-4400-858b-2af63cf43e11 on hv-cinder-84989 Aug 01 16:56:02.673326 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-cb5c3ef8-08a5-4a1c-8df4-d1c03643c61e req-f3408414-4942-457a-9729-8d18526b77cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Aug 01 16:56:02.674000 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 79/153] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:56:02.836701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:02.837902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:02.844097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.844547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.845412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.845826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.974708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:02.975841 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:02.982236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:02.985311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.985755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.986548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:02.986972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:02.989999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-087db305-4c94-4cc8-bf06-d5fa0274bbc3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.157125 Aug 01 16:56:02.990584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 75/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:02 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:03.173541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:03.175835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:03.184607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:03.185197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:03.186106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:03.186810 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:03.205395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:03.214695 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f0a48c2f-e416-457d-aca2-36a79770e351 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.244225 Aug 01 16:56:03.222065 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 80/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:02 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:03.340450 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:03.348348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-645a8ec2-c2df-403d-948b-179e227f9f31 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.179203 Aug 01 16:56:03.363153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 76/156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:03 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:04.014829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:04.016226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:04.023463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.023906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.024739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.025842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.164811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:04.173043 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ebb3ce40-f450-4095-ae5d-e34377ab8fff tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.164015 Aug 01 16:56:04.173716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 81/157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:04 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:04.236999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:04.237631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:04.244529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.245050 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.245926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.246381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.372362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:04.373115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:04.379809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.380314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.381661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:04.381814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:04.391872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:04.399841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6a3e23c5-7a97-4a25-b247-6e9f6d1e9365 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.167729 Aug 01 16:56:04.401058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 77/158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:04 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:04.583681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:04.591886 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2ed64595-2643-4ce4-a9ec-7d014192f8fd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.225100 Aug 01 16:56:04.598539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 82/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:04 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:05.204428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:05.205053 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:05.211059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.228948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.228948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.228948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.365346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:05.365346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-44729fe0-086d-4a6b-a908-73304de0cab7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.161545 Aug 01 16:56:05.365346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 78/160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:05 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:05.427283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:05.427935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:05.435210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.435678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.436443 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.436876 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.576534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:05.585003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0e6d0c7-a9d1-441a-bb4f-aeb90d3a8f22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.160846 Aug 01 16:56:05.585189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 83/161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:05 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:05.611958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:05.612654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:05.619501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.619944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.620705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:05.621135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:05.778164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:05.787075 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8649b4a8-23ba-41c3-8e9a-9067326aebf1 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.178920 Aug 01 16:56:05.787652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 79/162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:05 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:06.383569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:06.384266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:06.390342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.390779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.391541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.391973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.523488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:06.531622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c9549ce2-dac6-41e6-be83-0ad8d4c76688 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.151844 Aug 01 16:56:06.532189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 84/163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:06 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:06.607198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:06.607852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:06.613780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.614286 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.615057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.615497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.752904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:06.761043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bdec54ba-3fb9-47fc-ab65-b328d1c85da6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.158478 Aug 01 16:56:06.761608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 80/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:06 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:06.807007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:06.807707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:06.813837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.814307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.815211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:06.815638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:06.949873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:06.963775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-db107f47-ac12-479c-8f03-12f2742d6ddb tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.154268 Aug 01 16:56:06.963775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 85/165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:06 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:07.552870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:07.553698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:07.561070 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.561596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.562473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.562908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.690236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:07.699581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-03b54d35-c8e2-4e06-a517-4d87cfb81af3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.150548 Aug 01 16:56:07.700376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 81/166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:07 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:07.781937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:07.782513 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:07.788174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=80 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:07.789432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.789877 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.790809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.791320 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.928532 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:07.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e29d920f-7c88-42ec-a441-51b276b00138 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.158807 Aug 01 16:56:07.938158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 86/167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:07 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:07.979197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:07.979799 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:07.985681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.986145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.986894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:07.987322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:07.991283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:08.130248 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:08.131729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1afe6525-d701-481c-aa82-b64573b626a3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.156502 Aug 01 16:56:08.132305 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 82/168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:07 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:08.720666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:08.721228 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:08.727175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:08.731714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:08.731714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:08.731714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:08.859569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:08.867040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-64b0e357-34cc-428b-b53e-49950d828904 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.150254 Aug 01 16:56:08.867795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 87/169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:08 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:08.958225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:08.958827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:08.965048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:08.965489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:08.966265 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:08.966702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:09.093567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:09.101308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-27a672f2-2615-47ff-aed0-0dd53f1b2a1c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.146748 Aug 01 16:56:09.101884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 83/170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:08 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:09.152658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:09.153259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:09.159173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:09.159601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:09.160349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:09.160773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:09.292679 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:09.300043 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e9250f0a-ec0d-4cbc-a576-374821a872b2 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.151229 Aug 01 16:56:09.301270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 88/171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:09 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:09.887432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:09.888036 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:09.894044 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:09.894504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:09.895257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:09.895691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:10.040787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:10.040787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f732587e-a4df-4d4c-9dbf-734197359761 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.151029 Aug 01 16:56:10.040787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 84/172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:09 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:10.123700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:10.124235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:10.130321 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:10.130767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:10.131554 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:10.131988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:10.304018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:10.312210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fc8fdeda-d8e5-40af-953c-6d76074649cb tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.192431 Aug 01 16:56:10.312766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 89/173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:10 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:10.320957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:10.322240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:10.328350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:10.331644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:10.331644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:10.331644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:10.494089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:10.501717 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4e174cc0-d3a8-4fd6-aca6-bec2da2ee265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.184466 Aug 01 16:56:10.502321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 85/174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:10 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:11.055124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:11.055887 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:11.061894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.062413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.063173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.063613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.081165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:11.334706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:11.335206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:11.342655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.342964 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.344048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.344671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.413131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:11.437813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-40665cdd-6e96-4bc8-a329-945670130836 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.382334 Aug 01 16:56:11.440437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 90/175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:11 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:11.515042 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:11.522250 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d9793987-72f7-4924-8a68-bde8d4d35fb7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.191934 Aug 01 16:56:11.522811 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 86/176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:11 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:11.534302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:11.534302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:11.535309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.535761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.536889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:11.537327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:11.684856 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:11.692274 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9026d363-7eed-4d2c-8090-6f3c78dd7918 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1315 microversion: 2.1 time: 0.169203 Aug 01 16:56:11.692837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 91/177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:11 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:12.461197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:12.461820 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:12.468334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.469057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.469873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.470376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.543900 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:12.544742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:12.551633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.552260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.552774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.553390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.612832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:12.622747 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-45c42278-87c2-466b-b66e-c625e63c97da tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.165487 Aug 01 16:56:12.623486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 87/178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:12 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:12.700892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:12.708568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d139d3af-f56d-409c-af0a-561a6ab250b0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.168612 Aug 01 16:56:12.709120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 92/179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:12 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:12.713204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:12.713834 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:12.719960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.720464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.721223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:12.721655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:12.862230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:12.871044 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-aa089feb-57a1-420f-9078-cae24085af79 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1502 microversion: 2.1 time: 0.161868 Aug 01 16:56:12.871627 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 88/180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:12 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:13.645134 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:13.646010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:13.652742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:13.653182 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:13.653932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:13.654396 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:13.729237 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:13.729835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:13.742329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:13.742329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:13.742329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:13.742329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:13.830249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:13.845613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3bf4e1b7-10aa-4e43-9802-e4f5dedf467b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.204437 Aug 01 16:56:13.846529 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 93/181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:13 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:13.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:13.942071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-563d7f04-8c93-4c18-9fd2-36e41d75cafd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.217099 Aug 01 16:56:13.942650 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 89/182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:13 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:14.872774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:14.873637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:14.879753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:14.880200 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:14.880977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:14.881413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:14.972069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:14.973172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:14.979970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:14.980510 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:14.981333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:14.982059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:15.078901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:15.089578 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d0d66aa7-6e96-45a0-8755-5e209e732196 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.220598 Aug 01 16:56:15.090195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:14 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:15.119857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:15.127310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d723cd54-e8f4-408e-a583-c3bdf4a7c6a3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.159141 Aug 01 16:56:15.127867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:14 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:16.111272 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:16.111968 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:16.118716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:16.119220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:16.120019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:16.120454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:16.155380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:16.156014 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:16.162156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:16.162542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:16.163310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:16.163919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:16.283732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:16.291362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0a2ecaf8-3733-4704-95ba-f3844a94b62a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.183989 Aug 01 16:56:16.291937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 95/185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:16 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:16.328929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:16.336699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3d4d9776-d3b9-4672-ba7f-196d896adfbd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.185303 Aug 01 16:56:16.337292 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:16 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:17.312833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:17.313463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:17.319663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:17.320231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:17.321444 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:17.321811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:17.357168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:17.357815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:17.364204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:17.364653 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:17.365484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:17.365928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:17.468170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:17.480418 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2f35576e-702a-4f36-ae61-2418833739e1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.170885 Aug 01 16:56:17.481007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 96/187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:17 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:17.507367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:17.515648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e80a05e2-26d9-4049-9d1a-bf9eaa11a1c9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.162247 Aug 01 16:56:17.516215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 92/188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:17 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:18.502446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:18.503059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:18.509025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:18.509469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:18.510969 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:18.511405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:18.537520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:18.538210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:18.550054 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:18.550739 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:18.551867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:18.552310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:18.656850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:18.665116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5f6564e3-c041-4cef-841f-4fd52a3a595c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.166253 Aug 01 16:56:18.665550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 97/189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:18 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:18.695703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:18.703936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e91b2eee-1fee-4f8a-b932-057d80d667c2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.171050 Aug 01 16:56:18.704507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:18 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:19.686268 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:19.686789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:19.692899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:19.693347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:19.694149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:19.694583 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:19.730647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:19.731353 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:19.744829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:19.745934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:19.746762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:19.747179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:19.831870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:19.840163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c24a9501-b64f-48c5-9ef4-230f180140a4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.157891 Aug 01 16:56:19.840729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 98/191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:19 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:19.905031 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:19.914333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d65867ef-fdd0-4ba3-9810-5693c8a01bce tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.193212 Aug 01 16:56:19.915398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 94/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:19 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:20.860825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:20.861480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:20.867476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:20.868208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:20.868957 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:20.869384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:20.936933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:20.937549 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:20.947045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:20.947534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:20.948877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:20.949314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:21.023792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:21.034009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e0a899e3-987b-4198-ae49-b9f9247959e7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1322 microversion: 2.1 time: 0.176848 Aug 01 16:56:21.034831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 99/193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:20 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:21.121703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:21.125991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b7364e-b006-4ab1-8afe-5e645068622d"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:21.128427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:21.129993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7e910b93-923e-4bcb-95ad-87a95a1a7c7d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.197743 Aug 01 16:56:21.130971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 95/194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:20 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:21.135059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:21.135620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:21.138094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:21.138094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.056882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:22.058355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:22.064763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.065313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.066314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.066966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.231115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:22.240310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b695463a-6d82-45d7-b10b-3222542cc86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1516 microversion: 2.1 time: 0.188055 Aug 01 16:56:22.241063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:22 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:56:22.246477 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:22.247084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:22.254064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.254697 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.255756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.256331 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.280450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6eb51419-831b-4a35-80b4-687496340c19 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "POST /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.160094 Aug 01 16:56:22.286854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 100/196] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 16:56:21 2022] POST /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795/os-volume_attachments => generated 194 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:56:22.294179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:22.297377 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:22.306915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.307402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.308423 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.308865 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.360213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'flavor' on Instance uuid 0921a70d-6912-4400-858b-2af63cf43e11 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:56:22.435073 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:22.443841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4811ad44-b967-42fa-a798-7acc8150a961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.201813 Aug 01 16:56:22.444735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:22 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:22.738177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4a4fcf4a-9b26-4afb-97b4-239a5f4f9dc9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11/action" status: 200 len: 32 microversion: 2.1 time: 0.449365 Aug 01 16:56:22.739123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 101/198] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:56:22 2022] POST /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:56:22.748931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:22.749580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:22.755584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.756030 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.756792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:22.757226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:22.949942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:22.955786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:22.963002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-75858880-11cc-423d-b8fe-01c0767a3cfb tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.217973 Aug 01 16:56:22.963814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:22 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:23.470171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:23.471458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:23.487869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:23.499712 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:23.500684 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:23.501105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:23.708611 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:23.720806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df8fb544-3362-4da9-82a7-99e174eec5c0 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.259101 Aug 01 16:56:23.723664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 102/200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:23 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:23.985782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:23.986432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:23.992492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:23.993209 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:23.994004 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:23.994432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:24.254694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:24.264769 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dc092353-1a96-4c2a-a7e3-4b4723b58e73 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.284303 Aug 01 16:56:24.265911 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 99/201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:23 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:24.746645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:24.746645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:24.756604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:24.757054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:24.760960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:24.760960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:24.950400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-ed854f8c-d460-4e1b-8342-e9474301a885 req-fdd89e77-705c-4a75-a7b3-18fd1d4c4667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac7cea8-b1f2-4104-bb3b-083dcacbf502", "name": "network-vif-plugged", "status": "completed", "tag": "e12e7e64-d495-4d63-b74b-0480b5df984e"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:24.980407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-ed854f8c-d460-4e1b-8342-e9474301a885 req-fdd89e77-705c-4a75-a7b3-18fd1d4c4667 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:24.980854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-ed854f8c-d460-4e1b-8342-e9474301a885 req-fdd89e77-705c-4a75-a7b3-18fd1d4c4667 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:25.007134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-ed854f8c-d460-4e1b-8342-e9474301a885 req-fdd89e77-705c-4a75-a7b3-18fd1d4c4667 service nova] Creating event network-vif-plugged:e12e7e64-d495-4d63-b74b-0480b5df984e for instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 on hv-cinder-84989 Aug 01 16:56:25.033133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-ed854f8c-d460-4e1b-8342-e9474301a885 req-fdd89e77-705c-4a75-a7b3-18fd1d4c4667 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080096 Aug 01 16:56:25.033133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 100/202] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:56:25.048470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:25.052584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:25.084131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-374c83e4-ba08-47e8-8d39-8b1856e2c9c7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.318472 Aug 01 16:56:25.084131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 103/203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:24 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:25.287822 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:25.288531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:25.296802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:25.297571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:25.298556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:25.302193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:25.606992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:25.617563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3a59627a-1f96-40bf-9300-0ed374bd44b0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.333865 Aug 01 16:56:25.619213 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 101/204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:25 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:26.096829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:26.097628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:26.105359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:26.105895 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:26.106759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:26.107286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:26.304678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:26.318673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca23c7c7-e3cc-476b-96e8-bf97f4eb6c27 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.221197 Aug 01 16:56:26.323603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 104/205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:26 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:26.640057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:26.640664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:26.646600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:26.647045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:26.647798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:26.648396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:26.782698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:26.790586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-72ebdf3d-430d-4896-a452-5f373fff57d6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.154879 Aug 01 16:56:26.791202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 102/206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:26 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:27.336746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:27.337808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:27.353716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:27.357829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:27.359040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:27.360558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:27.554656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:27.566813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-96028cfd-62ba-45e7-a258-c049121c8d10 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1363 microversion: 2.1 time: 0.235036 Aug 01 16:56:27.567411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 105/207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:27 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:27.815111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:27.818429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:27.831789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:27.834145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:27.837705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:27.838569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:28.042689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:28.050191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-610aaec4-db4e-4858-83bd-cad4d02a053f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.238930 Aug 01 16:56:28.050983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 103/208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:27 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:28.587373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:28.588077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:28.597729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:28.598854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:28.599826 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:28.600431 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:28.739480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:28.749570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-da5b9186-7088-450b-b1ce-1bfc02ae34b3 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1549 microversion: 2.1 time: 0.165607 Aug 01 16:56:28.750276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 106/209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:28 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:28.771339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:28.771833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:28.779009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:28.779461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:28.780215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:28.780643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:28.898097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b38bbfab-ff3d-4cda-b745-bb121a1275d8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130607 Aug 01 16:56:28.898777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 16:56:28 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:56:29.074844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:29.075816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:29.085411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:29.085551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:29.086375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:29.086853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:29.637769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:29.651266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2391ad3-f0ae-4c8e-90a6-e97bf7c06a59 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.582989 Aug 01 16:56:29.652352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:29 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:30.674456 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:30.675187 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:30.677569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=68 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:30.684683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:30.689438 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:30.690428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:30.691524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:30.730696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-0d3a2b1f-44e7-41c2-8225-b3f9ac81e9d3 req-cbecd2cb-f7a9-4f17-9ed7-a790e52e767c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac7cea8-b1f2-4104-bb3b-083dcacbf502", "tag": "e12e7e64-d495-4d63-b74b-0480b5df984e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:30.747656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0d3a2b1f-44e7-41c2-8225-b3f9ac81e9d3 req-cbecd2cb-f7a9-4f17-9ed7-a790e52e767c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:30.751341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0d3a2b1f-44e7-41c2-8225-b3f9ac81e9d3 req-cbecd2cb-f7a9-4f17-9ed7-a790e52e767c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:30.784409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-0d3a2b1f-44e7-41c2-8225-b3f9ac81e9d3 req-cbecd2cb-f7a9-4f17-9ed7-a790e52e767c service nova] Creating event network-changed:e12e7e64-d495-4d63-b74b-0480b5df984e for instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 on hv-cinder-84989 Aug 01 16:56:30.794499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-0d3a2b1f-44e7-41c2-8225-b3f9ac81e9d3 req-cbecd2cb-f7a9-4f17-9ed7-a790e52e767c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076619 Aug 01 16:56:30.799893 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 108/212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:56:30.910547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:30.915162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0a81e5b3-19af-4385-9290-c3aa44c4fef2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.244822 Aug 01 16:56:30.930073 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:30 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:31.938630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:31.940174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:31.953775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:31.954460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:31.955391 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:31.956771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:32.168832 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:32.184771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-be9256a7-8ad4-4b25-a365-a8385a15ed88 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.247292 Aug 01 16:56:32.188052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:31 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:32.292770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:32.294447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:32.305012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:32.308161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:32.310722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:32.311758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:32.342247 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:56:32.687159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-09ae9610-f2cc-4d99-aee0-00b51ca0a9e3 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 204 len: 0 microversion: 2.1 time: 0.403039 Aug 01 16:56:32.687763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 16:56:32 2022] DELETE /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:56:32.697599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:32.697599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:32.702894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:32.703405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:32.704204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:32.704643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:32.855233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:32.863895 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ef87a210-2156-4b4f-9d52-dde224230ea5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.171774 Aug 01 16:56:32.865524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:32 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:33.209703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:33.210447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:33.217285 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:33.217730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:33.218518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:33.218954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:33.379235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:33.387739 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-306bb90d-38b6-4b6e-a82a-56b4daae976a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.182196 Aug 01 16:56:33.388307 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:33 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:33.886930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:33.888119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:33.894876 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:33.895517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:33.896312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:33.896922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:34.047472 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:34.055915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-aacba7af-14ec-4bc1-8d59-5ebb5bd30c17 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.173358 Aug 01 16:56:34.056550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:33 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:34.408516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:34.409636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:34.415752 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:34.416214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:34.417602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:34.418055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:34.592835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:34.605433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-06ee4e4c-4ba6-4483-b372-53aac27451bd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.200561 Aug 01 16:56:34.610398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:34 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:35.077556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:35.078210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:35.084693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:35.085143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:35.085914 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:35.086376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:35.217950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:35.227100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8f398d92-d23b-4927-91ae-9d2881e01895 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.153348 Aug 01 16:56:35.228263 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:35 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:35.629267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:35.630122 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:35.637095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:35.637837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:35.640813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:35.640813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:35.790303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:35.799610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5ae3e70b-35b5-4b3e-a5db-43ad31691206 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.174394 Aug 01 16:56:35.800184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:35 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:36.248966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:36.250266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:36.257266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:36.257919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:36.258711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:36.259315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:36.393894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:36.401763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e43d549f-f6e3-4cad-9c61-e0b02a7a4fa5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.157287 Aug 01 16:56:36.402373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 113/222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:36 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:36.820591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:36.821205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:36.827803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:36.828264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:36.829023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:36.829461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:36.972359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:36.990182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f44970c0-2816-42cb-81d2-8eeb51a9f735 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.164250 Aug 01 16:56:36.990182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:36 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:37.423042 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:37.423656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:37.430228 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:37.430676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:37.431432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:37.432491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:37.565145 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:37.573968 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d4e250b6-b1bc-42ef-a471-a189c3062ff8 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.154655 Aug 01 16:56:37.574575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:37 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:38.003828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:38.004452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:38.011112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:38.011550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:38.013034 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:38.013034 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:38.139274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:38.147076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-df845014-39ea-4b93-9633-574f12d09b84 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.146886 Aug 01 16:56:38.147623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:37 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:38.594867 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:38.595481 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:38.597840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=58 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:38.602606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:38.603082 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:38.604547 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:38.604984 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:38.741555 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:38.750939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c20dcc5e-62ca-4c65-8266-90c50c6864dc tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.159593 Aug 01 16:56:38.751766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:38 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:39.167875 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:39.168491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:39.174488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:39.174947 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:39.175720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:39.176155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:39.306203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:39.314167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c92dca5a-8886-41bf-ad54-44131c2a7715 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.150984 Aug 01 16:56:39.314958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 112/227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:39 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:39.773353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:39.774568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:39.781202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:39.781643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:39.782456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:39.782891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:39.926822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:39.935641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5420dfc4-bb47-4a69-9297-edf4a82e8dbd tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.166067 Aug 01 16:56:39.940559 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 116/228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:39 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:40.335927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:40.336596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:40.343642 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:40.344089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:40.344852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:40.345343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:40.490295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:40.505792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cf42e9b0-3870-479e-b811-7d7094928693 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.170999 Aug 01 16:56:40.505792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 113/229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:40 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:40.957901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:40.959245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:40.970644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:40.971869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:40.973173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:40.973837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:41.231063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-2d2c29e5-609d-463f-9717-711465371a9b req-ca796909-8769-4487-b025-081eadeffe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a14f063-efef-44ab-b5a4-9db169f84795", "name": "network-vif-deleted", "tag": "efe95d66-61db-4eb5-857f-50a23fb3edc4"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:56:41.233439 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:41.241239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-2d2c29e5-609d-463f-9717-711465371a9b req-ca796909-8769-4487-b025-081eadeffe80 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:41.241581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3146c2fb-de61-4b2b-8ce0-966b49338b21 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1554 microversion: 2.1 time: 0.288466 Aug 01 16:56:41.245786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-2d2c29e5-609d-463f-9717-711465371a9b req-ca796909-8769-4487-b025-081eadeffe80 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:41.245940 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 117/230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:40 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:41.258793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-2d2c29e5-609d-463f-9717-711465371a9b req-ca796909-8769-4487-b025-081eadeffe80 service nova] Creating event network-vif-deleted:efe95d66-61db-4eb5-857f-50a23fb3edc4 for instance 0a14f063-efef-44ab-b5a4-9db169f84795 on hv-cinder-84989 Aug 01 16:56:41.269596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-2d2c29e5-609d-463f-9717-711465371a9b req-ca796909-8769-4487-b025-081eadeffe80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038019 Aug 01 16:56:41.269596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 114/231] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:56:41.524948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:41.526210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:41.532598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:41.533049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:41.533816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:41.534284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:41.672178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:41.681029 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1aa7cae6-40f5-4c5d-99cd-feba57d7a167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.159961 Aug 01 16:56:41.681631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 118/232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:41 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:42.264351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:42.265099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:42.288437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:42.288437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:42.288437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:42.288437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:42.308771 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:42.323353 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:42.323804 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:42.324264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lazy-loading 'fault' on Instance uuid 0a14f063-efef-44ab-b5a4-9db169f84795 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:56:42.377193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d90db97f4334c41ba8e0e54fc14c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '704a245a8de14350b5ffe3d1d13ca1b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:42.386899 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d75b82d2-8507-40f0-ac52-5232d0453ed5 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 200 len: 1351 microversion: 2.1 time: 0.126824 Aug 01 16:56:42.387476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 115/233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:42 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:42.703786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:42.704624 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:42.712526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:42.713838 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:42.714799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:42.715309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:42.863918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:42.871883 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dd3123b9-3daf-44a1-85c8-183b2b2f53f7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.172397 Aug 01 16:56:42.872452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:42 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:43.417266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:43.417890 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:43.424585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.425027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:43.425800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.426264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:43.440527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] HTTP exception thrown: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Request method failure captured: Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 HTTP/1.1 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVp7J5ewDQAAxJg9xun5FJ7pPM1dt6Hda1skS7ray2Hic6BNqpfrJAtSef9iDqveKlU-y53lw6Pf4-DgUO-jG1md24rvkR6S7YTB7DHE6cFJd2WMMC2kTDWcZOqSm9zHKf5877lzBjdwgORFVO5qAJJIieFNRXKIdD0zgk4Vu6qjME Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:56:43.445165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 0d90db97f4334c41ba8e0e54fc14c317 Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.446667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '0a14f063-efef-44ab-b5a4-9db169f84795'} Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:56:43.448090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.449620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.450925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Returning 404 to user: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:56:43.450925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cdf82585-125b-471c-a834-42493e2a5945 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 404 len: 111 microversion: 2.1 time: 0.033886 Aug 01 16:56:43.450925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:43 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:43.564445 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:43.566792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:43.573318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.573758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:43.574546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.574983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:43.587124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] HTTP exception thrown: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Request method failure captured: Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795/os-volume_attachments HTTP/1.1 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVp7J5ewDQAAxJg9xun5FJ7pPM1dt6Hda1skS7ray2Hic6BNqpfrJAtSef9iDqveKlU-y53lw6Pf4-DgUO-jG1md24rvkR6S7YTB7DHE6cFJd2WMMC2kTDWcZOqSm9zHKf5877lzBjdwgORFVO5qAJJIieFNRXKIdD0zgk4Vu6qjME Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 16:56:43.600972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 0d90db97f4334c41ba8e0e54fc14c317 Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.605892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'server_id': '0a14f063-efef-44ab-b5a4-9db169f84795'} Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:56:43.606605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:43.607669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:43.608858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Returning 404 to user: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:56:43.608858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-657a3f4f-f4eb-4f25-b38c-2ad0552fd265 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042019 Aug 01 16:56:43.608858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 16:56:43 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:43.894188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:43.894803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:43.913808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.914738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:43.915242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:43.915881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:44.078192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:44.084853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-03cd72e6-dea0-4a69-abf7-a7798b0bb9f8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.194833 Aug 01 16:56:44.085429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 117/237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:43 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:45.004648 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:45.010192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:45.012743 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.013196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.013975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.014460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.038517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] HTTP exception thrown: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Request method failure captured: Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 HTTP/1.1 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVp7J5ewDQAAxJg9xun5FJ7pPM1dt6Hda1skS7ray2Hic6BNqpfrJAtSef9iDqveKlU-y53lw6Pf4-DgUO-jG1md24rvkR6S7YTB7DHE6cFJd2WMMC2kTDWcZOqSm9zHKf5877lzBjdwgORFVO5qAJJIieFNRXKIdD0zgk4Vu6qjME Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 16:56:45.041067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 0d90db97f4334c41ba8e0e54fc14c317 Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.042470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '0a14f063-efef-44ab-b5a4-9db169f84795'} Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:56:45.043347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.044727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.046298 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Returning 404 to user: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:56:45.046298 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3f97c67d-06a9-4b14-821d-34b2aa62630f tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 404 len: 111 microversion: 2.1 time: 0.048586 Aug 01 16:56:45.051502 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 16:56:44 2022] DELETE /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:45.061779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:45.061779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] [instance: 0a14f063-efef-44ab-b5a4-9db169f84795] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:45.063492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.064452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.065563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.066196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.083450 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] HTTP exception thrown: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Request method failure captured: Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 HTTP/1.1 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVp7J5ewDQAAxJg9xun5FJ7pPM1dt6Hda1skS7ray2Hic6BNqpfrJAtSef9iDqveKlU-y53lw6Pf4-DgUO-jG1md24rvkR6S7YTB7DHE6cFJd2WMMC2kTDWcZOqSm9zHKf5877lzBjdwgORFVO5qAJJIieFNRXKIdD0zgk4Vu6qjME Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:56:45.085304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704a245a8de14350b5ffe3d1d13ca1b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 704a245a8de14350b5ffe3d1d13ca1b2 Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087166585 Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 0d90db97f4334c41ba8e0e54fc14c317 Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-DeleteServersTestJSON-2087166585-project Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.086785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '0a14f063-efef-44ab-b5a4-9db169f84795'} Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:56:45.087594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. Aug 01 16:56:45.089458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:56:45.091809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] Returning 404 to user: Instance 0a14f063-efef-44ab-b5a4-9db169f84795 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:56:45.092825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b354ced5-64ab-48b7-9448-81b6a796b500 tempest-DeleteServersTestJSON-2087166585 tempest-DeleteServersTestJSON-2087166585-project] 10.222.0.20 "GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795" status: 404 len: 111 microversion: 2.1 time: 0.042441 Aug 01 16:56:45.093861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 118/239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:45 2022] GET /compute/v2.1/servers/0a14f063-efef-44ab-b5a4-9db169f84795 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:45.107299 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:45.108082 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:45.115374 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.116047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.116996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:45.118634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:45.141047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:45.311700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:45.324265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-65642b72-e5a0-4c38-bc9b-1973dbcbaf9b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.221356 Aug 01 16:56:45.325269 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 122/240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:45 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:46.346863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:46.347476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:46.354330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:46.355032 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:46.355813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:46.356421 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:46.794893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:46.819788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8911a2ff-cbce-4438-b40f-cc1b4032d18e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.476559 Aug 01 16:56:46.837750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 119/241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:46 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:47.841438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:47.842673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:47.851017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:47.851733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:47.853048 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:47.854686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:48.065471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:48.073891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-659e917c-15ef-4672-b7be-820644438796 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.236926 Aug 01 16:56:48.089095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:47 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:49.108652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:49.109163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:49.126309 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:49.126767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:49.128949 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:49.135163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:49.405552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:49.417249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b20bfa84-63e3-4802-a3ce-e4a99d8391ca tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.324504 Aug 01 16:56:49.435457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 120/243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:49 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:50.439389 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:50.440001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:50.446793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:50.447340 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:50.448466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:50.449201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:50.616061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:50.624005 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a7757989-7eaf-4084-b702-d540c38b454b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.189065 Aug 01 16:56:50.624582 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:50 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:51.644709 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:51.645310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:51.654197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:51.654197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:51.654197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:51.654197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:51.824683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:51.832717 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-91e9b588-c0c8-4588-ba9e-0255d3f3c750 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.191831 Aug 01 16:56:51.833528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:51 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:52.861575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:52.862359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:52.870616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:52.870983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:52.871760 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:52.872252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:53.081836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:53.096506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9b5fa089-0740-4fc2-87ed-8025085ca457 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.243046 Aug 01 16:56:53.097284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:52 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:54.123611 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:54.124780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:54.131233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:54.131684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:54.132450 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:54.132884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:54.309284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:54.316655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-724f13ac-306c-43fb-b36c-42855ca3eaef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.201610 Aug 01 16:56:54.317720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:54 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:55.338463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:55.339735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:55.346927 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:55.347621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:55.348665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:55.349344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:55.525912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:55.542007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1f6ee305-cf81-435d-ba7c-326a14d3b3ee tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.207586 Aug 01 16:56:55.542969 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:55 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:56.564137 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:56.564896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:56.571643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:56.574058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:56.574881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:56.575966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:56.885224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:56.906178 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-51317915-d07a-4eed-ba6f-b7a960de36b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.345643 Aug 01 16:56:56.919876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 123/249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:56 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:57.931929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:57.933675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:57.940390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:57.941417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:57.943027 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:57.943683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:58.117972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:58.129198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b5a9f44f-1fd1-4da2-abd0-9fe288c2db33 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.201499 Aug 01 16:56:58.134199 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:57 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:56:59.159163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:56:59.160769 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:56:59.175505 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:59.184516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:59.185379 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:56:59.185814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:56:59.485788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:56:59.495461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-82801fca-d65b-4b50-9527-a81740d066b7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.346325 Aug 01 16:56:59.502704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 124/251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:56:59 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:00.479515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-32b494da-eb65-48d9-a11f-f7f1062de9a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: .version_select at 0x7f733dd6c700>, body: {"keypair": {"name": "tempest-keypair-432608160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUqpqWhDtSDm5J9bAYTje3dskXmj2Jp0jM3JgztfS1n72jKQO+MHrMx4gsU4am3XyCtJjAf1w5nzdT28Rlm1rpiNAnVAeQI0PglNoiDobtUdvz2Zf2NrGjJUuhhWQTmCQ=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:00.501519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-32b494da-eb65-48d9-a11f-f7f1062de9a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for project dfc1c3badb144d24a2b86341a155505a. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:57:00.508238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-32b494da-eb65-48d9-a11f-f7f1062de9a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for user 48cc0715e7b04f8a8c9f0d8c455bd4c6 and project dfc1c3badb144d24a2b86341a155505a. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:57:00.521596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:00.522723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:00.533560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:00.534301 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:00.536825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:00.536825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:00.648172 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-32b494da-eb65-48d9-a11f-f7f1062de9a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.412226 Aug 01 16:57:00.648948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 128/252] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 1 16:57:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 414 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 01 16:57:00.697931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:00.706608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5cd288d3-0a37-4cf4-9f8b-c278e9456c55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.193055 Aug 01 16:57:00.707193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:00 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:01.730362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:01.731145 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:01.738023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:01.738867 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:01.739323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:01.739750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:01.890171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:01.898888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cd87a10c-a6d3-471d-a23f-7124bd333f71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.174307 Aug 01 16:57:01.913171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 129/254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:01 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:02.921379 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:02.922100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:02.925049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:02.931663 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:02.932772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:02.933783 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:02.934825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:03.114836 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:03.132162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-805b1fc8-eebd-4575-ab9d-e896bf2f4d94 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.216498 Aug 01 16:57:03.132781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:02 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:03.205798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-64422843", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "680c38bc-09b1-4d5d-b6e3-97006e991feb"}], "security_groups": [{"name": "tempest-securitygroup--2067735353"}], "key_name": "tempest-keypair-432608160", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:03.457385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] validate_networks() for [('680c38bc-09b1-4d5d-b6e3-97006e991feb', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:57:03.832427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:57:03.832844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:57:03.833312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:57:03.833714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:57:03.834158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:57:03.844371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:03.844371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:03.844980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:03.845413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:03.861842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for project dfc1c3badb144d24a2b86341a155505a. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:57:03.865733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for user 48cc0715e7b04f8a8c9f0d8c455bd4c6 and project dfc1c3badb144d24a2b86341a155505a. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:57:03.877233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:57:03.879528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:57:04.019953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-554ad817-b308-432f-9ab5-58f265142253 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.819238 Aug 01 16:57:04.021060 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 130/256] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 1 16:57:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 16:57:04.038110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:04.039298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:04.092660 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:04.102876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:04.102876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:04.102876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e39d09cd-961f-42fd-88e1-09e3a9c68668 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1279 microversion: 2.20 time: 0.074199 Aug 01 16:57:04.103343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 127/257] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:04 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1279 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:57:04.157044 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:04.157708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:04.164837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:04.166152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:04.167069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:04.167583 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:04.299443 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:04.307573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6f34312d-df3a-42ff-9067-c90bcc5ea52b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.154729 Aug 01 16:57:04.308129 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:04 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:05.125142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:05.125864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:05.132030 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:05.132465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:05.136961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:05.136961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:05.196306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:05.205519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:05.207218 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:05.208891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-01a494e3-152e-4d34-9caf-22029fe11334 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1283 microversion: 2.20 time: 0.087934 Aug 01 16:57:05.209656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 128/259] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:05 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:05.328731 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:05.329343 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:05.335871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:05.336313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:05.337126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:05.338122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:05.467709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:05.475365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2d78b543-4713-40b6-a42c-4567ef8421a7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.150504 Aug 01 16:57:05.475929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 132/260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:05 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:06.231908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:06.232515 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:06.238559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:06.239018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:06.239761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:06.240191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:06.300960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:06.309568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:06.311105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:06.312516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0a70a544-f0e3-49de-8025-f3ace8f5d070 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1283 microversion: 2.20 time: 0.085193 Aug 01 16:57:06.313080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 129/261] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:06 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1283 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:06.497133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:06.497827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:06.504315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:06.504760 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:06.505554 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:06.506159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:06.631047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:06.638653 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a5f606f-a88c-4a6e-9a09-8c5d7a2edb8d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.145526 Aug 01 16:57:06.639218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 133/262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:06 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:07.334706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:07.335333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:07.341785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:07.342271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:07.343039 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:07.343474 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:07.407063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:07.415053 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:07.417115 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:07.418242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-540e3ec7-9484-4d6c-9cad-f80aeae76700 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1283 microversion: 2.20 time: 0.087439 Aug 01 16:57:07.418796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 130/263] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:07 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:07.659985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:07.660509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:07.667509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:07.667959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:07.668723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:07.669158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:07.794619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:07.801888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfba7c32-ea43-4987-840e-aeed8d5afe61 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.145836 Aug 01 16:57:07.802486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 134/264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:07 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:08.440616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:08.441216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:08.447231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:08.447652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:08.448467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:08.448850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:08.509511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:08.517474 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:08.519023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:08.520147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-988a95b7-c9ce-42c7-ad45-41f37b06a465 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1283 microversion: 2.20 time: 0.083374 Aug 01 16:57:08.520715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 131/265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:08 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:08.823583 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:08.824196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:08.826543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:08.831293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:08.831741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:08.832499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:08.832935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:08.968370 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:08.975958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-48409d1a-0578-4e63-b99a-cc3417ed7127 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.156271 Aug 01 16:57:08.976533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 135/266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:08 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:09.544090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:09.544783 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:09.551465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:09.566468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:09.566468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:09.566468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:09.613644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:09.622131 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:09.623651 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:09.624741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d3559b1c-c83c-41b1-9f32-80fb2fcaf904 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1283 microversion: 2.20 time: 0.085153 Aug 01 16:57:09.625293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 132/267] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:09 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1283 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:09.997706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:09.998351 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:10.004754 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:10.009993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:10.009993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:10.009993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:10.144184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:10.151904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d7648fd3-f434-4afa-b180-38d0a5d748dc tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.158381 Aug 01 16:57:10.152477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 136/268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:09 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:10.647148 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:10.647764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:10.654698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:10.655148 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:10.655923 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:10.656357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:10.729549 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:10.737957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:10.739661 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:10.740942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1350492b-bd19-41c9-934b-321756fe4a2e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1275 microversion: 2.20 time: 0.097752 Aug 01 16:57:10.741771 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 133/269] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:10 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:11.172614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:11.173335 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:11.180174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:11.180660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:11.181599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:11.182047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:11.361767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:11.370723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1a50bc85-608c-4e5c-96a7-6a63ece38d0d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1522 microversion: 2.1 time: 0.202019 Aug 01 16:57:11.371620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 137/270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:11 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:11.764887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:11.765493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:11.771520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:11.771968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:11.772808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:11.773242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:11.777808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:11.840350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:11.849998 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:11.857007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:11.864259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-60512b56-9f32-42d3-8da8-bdb4282836de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1339 microversion: 2.20 time: 0.097346 Aug 01 16:57:11.864259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 134/271] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:11 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:12.392891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:12.395076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:12.400864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.401316 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.402111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.402545 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.575854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:12.604916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-262408d3-433b-4c22-8f53-7a59b83fd43b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1502 microversion: 2.1 time: 0.196746 Aug 01 16:57:12.604916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 138/272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:12 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:12.607492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:12.608289 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:12.614337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.614781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.615608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.616211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.880904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:12.881525 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:12.888339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.890976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.890976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:12.890976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:12.903736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:12.915223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bec41aed-7a2a-42aa-b9f8-00606bfef957 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1517 microversion: 2.1 time: 0.312335 Aug 01 16:57:12.916205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 135/273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:12 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:12.986906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:12.995662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:12.997982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:12.998814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-60c6136b-3e6e-4fcb-99b9-8f0fb4c980db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1337 microversion: 2.20 time: 0.121931 Aug 01 16:57:12.999490 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 139/274] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:12 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:57:14.029087 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:14.029794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:14.035889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:14.036397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:14.037401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:14.037869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:14.097508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:14.171346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:14.179324 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:14.180827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:14.181961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-66036b39-fc41-4264-a989-a652d5095e4d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.156727 Aug 01 16:57:14.183342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 136/275] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:14 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:14.306950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-f58dbda6-1784-44a3-bc18-7b2cc3b1cfe1 req-b66848b8-0643-4b4d-b138-252c25eb12d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:14.312866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:14.318534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=10 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:14.318798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f58dbda6-1784-44a3-bc18-7b2cc3b1cfe1 req-b66848b8-0643-4b4d-b138-252c25eb12d2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:14.319238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f58dbda6-1784-44a3-bc18-7b2cc3b1cfe1 req-b66848b8-0643-4b4d-b138-252c25eb12d2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:14.330634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-f58dbda6-1784-44a3-bc18-7b2cc3b1cfe1 req-b66848b8-0643-4b4d-b138-252c25eb12d2 service nova] Creating event network-changed:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 16:57:14.335552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-f58dbda6-1784-44a3-bc18-7b2cc3b1cfe1 req-b66848b8-0643-4b4d-b138-252c25eb12d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Aug 01 16:57:14.340195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 140/276] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:57:15.205346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:15.205877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:15.212204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:15.212655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:15.214131 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:15.214729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:15.344515 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:15.352491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:15.353980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:15.355091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7cc1a2ed-803b-4ae4-9844-80b63a70d5a0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.154136 Aug 01 16:57:15.355634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 137/277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:15 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:16.379168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:16.379901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:16.387309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:16.387760 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:16.388517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:16.388955 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:16.407150 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:16.523007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:16.531003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:16.532497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:16.533586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-28746eb4-1334-4640-9033-c14df73d61bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.159600 Aug 01 16:57:16.534165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 141/278] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:16 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:16.842576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:16.845082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:16.851816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:16.852259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:16.853021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:16.853619 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:16.887866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'flavor' on Instance uuid 27932a15-1227-4a4d-9d0a-11f8acddde3d {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:57:17.313919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c64501cb-0f24-4818-96a9-856dce384394 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/action" status: 200 len: 32 microversion: 2.1 time: 0.478957 Aug 01 16:57:17.316104 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 138/279] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:57:16 2022] POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:57:17.326511 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:17.327120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:17.333030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:17.333473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:17.334347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:17.334776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:17.473873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:17.483893 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-196d795b-9228-4fa0-98cf-6227592da27b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.160636 Aug 01 16:57:17.484851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 142/280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:17 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:17.557201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:17.558383 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:17.567770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:17.570195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:17.570195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:17.570195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:17.753561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:17.765710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:17.767266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:17.768418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b3495438-5b91-467f-a753-3f765679ab66 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.215446 Aug 01 16:57:17.778313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 139/281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:17 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:18.508528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:18.509146 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:18.522351 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:18.522793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:18.523784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:18.524226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:18.752479 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:18.763785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4edf8050-99a0-4465-bbb3-99e906809ba7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.258932 Aug 01 16:57:18.771643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 143/282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:18 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:18.795497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:18.796298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:18.802720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:18.803428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:18.804431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:18.805198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:19.004132 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:19.012704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:19.014402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:19.015563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9a2fe035-3757-4702-84c4-1c38f4846b71 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.225049 Aug 01 16:57:19.016124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 140/283] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:18 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:19.785574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:19.786152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:19.793086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:19.793559 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:19.794342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:19.794770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:20.008286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:20.017121 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a650f6c9-f514-4fa2-b644-42ebbac4d5a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.235486 Aug 01 16:57:20.017698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 144/284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:19 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:20.041770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:20.044258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:20.051105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:20.051867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:20.052647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:20.053076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:20.272435 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:20.275258 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1117ff40-e316-4e32-906f-bf4644a8b720 req-7db189ac-23dc-452f-942b-aa923ccc43fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "name": "network-vif-plugged", "status": "completed", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:20.286531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1117ff40-e316-4e32-906f-bf4644a8b720 req-7db189ac-23dc-452f-942b-aa923ccc43fe service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:20.287113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1117ff40-e316-4e32-906f-bf4644a8b720 req-7db189ac-23dc-452f-942b-aa923ccc43fe service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:20.289799 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:20.292461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:20.293700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cfac8b2a-c97e-40a5-9a9f-addeb7d42720 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.257715 Aug 01 16:57:20.295061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 141/285] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:20 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:20.306204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1117ff40-e316-4e32-906f-bf4644a8b720 req-7db189ac-23dc-452f-942b-aa923ccc43fe service nova] Creating event network-vif-plugged:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 16:57:20.306204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1117ff40-e316-4e32-906f-bf4644a8b720 req-7db189ac-23dc-452f-942b-aa923ccc43fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038872 Aug 01 16:57:20.306204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 145/286] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:57:21.038770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:21.039676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:21.046812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:21.047365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:21.048233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:21.048710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:21.319489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:21.326401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:21.333593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:21.334104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:21.334925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:21.335379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:21.374816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:21.391937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-450d42db-50f8-449f-92af-db6500495a09 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.353693 Aug 01 16:57:21.407960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 142/287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:21 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:21.523701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:21.538794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:21.544382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:21.545700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-79ec7660-3aa6-4395-b134-9663803c7e88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.231006 Aug 01 16:57:21.546241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 146/288] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:21 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:22.416596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:22.417203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:22.429621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:22.430765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:22.430917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:22.431479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:22.568681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:22.569282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:22.578268 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:22.578720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:22.579483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:22.580093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:22.734627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:22.749032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:22.750633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:22.752180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f3c6c725-f6f6-45f7-9783-6de2a5903d85 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1405 microversion: 2.20 time: 0.187343 Aug 01 16:57:22.763691 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 147/289] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:22 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:22.772242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:22.783538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c285e91f-db53-4d36-912a-88ec958739c1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.370931 Aug 01 16:57:22.786632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:22 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:23.776670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:23.778122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:23.784768 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.785213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.785979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.786436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.810517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:23.811260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:23.817712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.818348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.819302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.819879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.953178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:23.961392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:23.966993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:23.966993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-443cdfc7-a60a-4d27-89f1-6aee8688e4c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1597 microversion: 2.20 time: 0.191605 Aug 01 16:57:23.966993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 148/291] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 16:57:23 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1597 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:57:23.985389 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:23.986385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:23.986883 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:23.993122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.993764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.994618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:23.995961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:23.996592 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-252f2965-2473-4e30-9b69-41bb8c703937 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.190268 Aug 01 16:57:23.998079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:23 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:24.118583 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-707b039b-7a63-4e44-a5b2-20d367a9e677 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135885 Aug 01 16:57:24.126959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 149/293] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 1 16:57:23 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:57:25.019897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:25.020616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:25.031082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:25.033026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:25.034276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:25.035191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:25.503676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:25.508558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6cb3691-a9f7-49b0-8fe4-f76c28afdfc7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.493087 Aug 01 16:57:25.533441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 145/294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:25 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:25.891218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-44a0fe93-05a2-45e4-bb83-d94a31e64c8f req-cf939fd7-6b3e-45db-9fea-c79e8595bdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:25.900613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-44a0fe93-05a2-45e4-bb83-d94a31e64c8f req-cf939fd7-6b3e-45db-9fea-c79e8595bdcd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:25.901059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-44a0fe93-05a2-45e4-bb83-d94a31e64c8f req-cf939fd7-6b3e-45db-9fea-c79e8595bdcd service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:25.914225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-44a0fe93-05a2-45e4-bb83-d94a31e64c8f req-cf939fd7-6b3e-45db-9fea-c79e8595bdcd service nova] Creating event network-changed:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 16:57:25.919384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-44a0fe93-05a2-45e4-bb83-d94a31e64c8f req-cf939fd7-6b3e-45db-9fea-c79e8595bdcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Aug 01 16:57:25.920024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 150/295] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:57:26.533000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:26.537415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:26.548183 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:26.548633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:26.549413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:26.549849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:26.762588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:26.771160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a9c8378f-07e4-4c02-b568-ba62f0a409f6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.242381 Aug 01 16:57:26.771736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:26 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:27.794999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:27.796034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:27.802118 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:27.802591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:27.803349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:27.803786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:27.953180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:27.960754 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9c9d017b-0ea3-4878-9e98-4b7706e36065 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.171817 Aug 01 16:57:27.961324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:27 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:28.983025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:28.985793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:28.990349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:28.991509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:28.992461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:28.992906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:29.220974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:29.233172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8d851792-55d6-4b7b-bc47-3a99827aa1a3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.254481 Aug 01 16:57:29.243123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:28 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:30.257589 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:30.258362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:30.267097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:30.267649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:30.269911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:30.270523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:30.509990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:30.522495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7623353f-845d-4905-a32c-6a3a50dacb2e tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.270661 Aug 01 16:57:30.523356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:30 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:31.548453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:31.549139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:31.555610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:31.556168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:31.556948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:31.557381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:31.702010 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:31.705574 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:31.709976 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5da53d9b-ed20-48b9-a2c1-d2b27ebc8999 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.167539 Aug 01 16:57:31.710581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:31 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:32.731177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:32.731779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:32.738354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:32.738797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:32.739550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:32.739977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:32.889995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:32.900055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8cb9fc76-aa48-486e-8c00-63963d22d86b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.172294 Aug 01 16:57:32.904660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 153/301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:32 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:33.924759 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:33.925372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:33.931093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=48 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:33.933894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:33.934585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:33.935552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:33.936144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:34.118427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:34.131294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c6458f95-392d-4274-92ce-ec03a0fef649 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.210169 Aug 01 16:57:34.132145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 149/302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:33 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:35.159781 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:35.163380 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:35.181961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:35.181961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:35.182822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:35.184040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:35.547729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:35.560400 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d31d7afe-0eb8-4228-9ee0-11579dfd7e2d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.409875 Aug 01 16:57:35.581308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 154/303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:35 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:36.594548 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:36.595210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:36.601963 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:36.602482 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:36.603640 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:36.604117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:36.776942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:36.784588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2849bcdd-a36d-4034-ad3c-99329dba5b55 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.195108 Aug 01 16:57:36.785147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 150/304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:36 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:37.807147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:37.807831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:37.815852 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:37.816821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:37.817790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:37.818512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:38.001491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:38.011898 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-85908dac-0030-41b4-bc91-c6e2443387d0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.208538 Aug 01 16:57:38.026115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 155/305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:37 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:39.034351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:39.035216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:39.042781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:39.044155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:39.045253 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:39.046000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:39.255546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:39.274496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-85573eab-6f10-485c-8296-00b7a2cbdbc2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.244539 Aug 01 16:57:39.275224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 151/306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:39 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:40.296397 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:40.297018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:40.299470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=42 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:40.306073 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:40.306804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:40.307968 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:40.308565 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:40.458533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:40.468310 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-044e5240-4a1d-48f0-a247-8267a3d21c2a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.176346 Aug 01 16:57:40.469069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:40 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:41.491191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:41.492021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:41.498542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:41.498993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:41.499764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:41.500203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:41.664866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:41.673617 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a01a5184-169f-4a23-8c2d-c27070b10933 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.186589 Aug 01 16:57:41.674597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 152/308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:41 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:42.696113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:42.696733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:42.711344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:42.711796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:42.712642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:42.713083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:42.854107 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:42.862765 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-67fc7f82-adbc-4532-8a78-975d4f6d9492 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.170936 Aug 01 16:57:42.863807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 157/309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:42 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:43.889387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:43.889981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:43.895927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:43.896371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:43.897130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:43.897594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.041815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:44.049552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6aa94ac3-3505-4ed9-be7d-84de4e732f9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1503 microversion: 2.1 time: 0.164698 Aug 01 16:57:44.050144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 153/310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:43 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:44.070825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ddc346-e485-48bc-ab42-ae20d84fa484"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:44.073146 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:44.080319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.080773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.081658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.082133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.107663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] HTTP exception thrown: Cannot 'attach_volume' instance 27932a15-1227-4a4d-9d0a-11f8acddde3d while it is in vm_state rescued Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Request method failure captured: Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/os-volume_attachments HTTP/1.1 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 74 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVuTp1cjRXSsjnVLuWdfKw2MyFRF9Yaa0YCWVsV5c5BXAzW7gUOYKqgzMSCEXKqdp_0KiE-3fH7MVYhZjQvjEcWcyeR_jaW8HyWJsuwU2waAIXkEDhn6_fIbISqqjH1T8SBmYaxHlmVD9DpLxlm-FEZqj-Mq_Mu3aiav6E_9FrtR14 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 16:57:44.109333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64929e340dae4c0f90162702aab5bc21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: b353fdd302394227987a6ae8c2943173 Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {"volumeAttachment": {"volumeId": "20ddc346-e485-48bc-ab42-ae20d84fa484"}} Aug 01 16:57:44.111249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Cannot 'attach_volume' instance 27932a15-1227-4a4d-9d0a-11f8acddde3d while it is in vm_state rescued Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'server_id': '27932a15-1227-4a4d-9d0a-11f8acddde3d', 'body': {'volumeAttachment': {'volumeId': '20ddc346-e485-48bc-ab42-ae20d84fa484'}}} Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:57:44.112356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 27932a15-1227-4a4d-9d0a-11f8acddde3d while it is in vm_state rescued Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:57:44.113744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 27932a15-1227-4a4d-9d0a-11f8acddde3d while it is in vm_state rescued Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Returning 409 to user: Cannot 'attach_volume' instance 27932a15-1227-4a4d-9d0a-11f8acddde3d while it is in vm_state rescued {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4da9b72c-5ece-4d7a-9317-7c37930ae83c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044131 Aug 01 16:57:44.115312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 158/311] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 16:57:44 2022] POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 16:57:44.121818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:44.121818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:44.127928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.128383 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.129161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.129597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.351313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e80c2c88-7538-412d-9451-c31ffa918470 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'create', calling method: .version_select at 0x7f733e6b49d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-96049143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8u/ox77frUnvm1UyAwnhjtAvt4gv2J5EgaIUIAaSE0CwG093dzDocm1DVYbZP+w2jfC/cxSWmOfdW4egiH7woM7JpHDb0BV6PACz63qfZAZuskKfUW/OKrgVsowukPGw=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:44.366495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-e80c2c88-7538-412d-9451-c31ffa918470 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Getting quotas for project d9fb92139d3643b2bb7ed4bfed2eae67. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:57:44.370247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-e80c2c88-7538-412d-9451-c31ffa918470 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Getting quotas for user b2d83a4ae8684f3183756b2dcfc4d514 and project d9fb92139d3643b2bb7ed4bfed2eae67. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:57:44.379361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d52797c5-2d7c-4009-9680-52ca91fb9d9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/action" status: 202 len: 0 microversion: 2.1 time: 0.262712 Aug 01 16:57:44.380019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 154/312] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:57:44 2022] POST /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:57:44.390233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:44.391251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:44.397744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.398233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.399012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:44.399469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:44.463041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e80c2c88-7538-412d-9451-c31ffa918470 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.115460 Aug 01 16:57:44.463641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 159/313] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 16:57:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:57:44.521601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1807693708", "imageRef": "1445328d-93b1-4c7e-8506-08a8d60a1573", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-96049143", "networks": [{"uuid": "c338f041-e477-4cb9-baa4-341d5460f97c"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:44.534814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:44.543697 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3f7b0c70-ca0c-40bf-a360-c15387cde404 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1511 microversion: 2.1 time: 0.158428 Aug 01 16:57:44.544434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 155/314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:44 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:44.575918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] validate_networks() for [('c338f041-e477-4cb9-baa4-341d5460f97c', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:57:45.212759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:57:45.213547 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:57:45.214066 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:57:45.214503 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:57:45.215982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:57:45.226126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:45.226685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:45.227569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:45.228100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:45.247767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Getting quotas for project d9fb92139d3643b2bb7ed4bfed2eae67. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:57:45.251842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Getting quotas for user b2d83a4ae8684f3183756b2dcfc4d514 and project d9fb92139d3643b2bb7ed4bfed2eae67. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:57:45.263588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:57:45.265989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1445328d-93b1-4c7e-8506-08a8d60a1573',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:57:45.367126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4a46cf35-53cb-4b21-bb2e-73614f9ad264 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850050 Aug 01 16:57:45.367785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 160/315] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:57:45.378548 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fea269ce-031b-4b4a-8cdd-6bcc0d99cd67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:45.379222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fea269ce-031b-4b4a-8cdd-6bcc0d99cd67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:45.435821 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-fea269ce-031b-4b4a-8cdd-6bcc0d99cd67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:45.442770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fea269ce-031b-4b4a-8cdd-6bcc0d99cd67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1257 microversion: 2.1 time: 0.068190 Aug 01 16:57:45.443323 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:45 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:45.564802 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:45.565412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:45.571540 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:45.571986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:45.572824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:45.573208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:45.705228 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:45.708601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:45.713026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de102bed-f1d3-493f-9f5f-976e8446a5db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1511 microversion: 2.1 time: 0.152125 Aug 01 16:57:45.714191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 161/317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:45 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:46.463609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:46.465429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:46.470669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:46.471125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:46.471896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:46.472333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:46.532915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:46.540633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ab17e532-c776-421a-b743-fa2a6247da8d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1261 microversion: 2.1 time: 0.080679 Aug 01 16:57:46.541220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 157/318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:46 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:46.734328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:46.734970 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:46.742140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:46.742590 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:46.743353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:46.743789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:46.868906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:46.876972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59b4486e-7a8b-4b63-9501-38480391cc6c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1511 microversion: 2.1 time: 0.146537 Aug 01 16:57:46.877541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 162/319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:46 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:47.562476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:47.563084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:47.569069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:47.569508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:47.570288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:47.570718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:47.630320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:47.638424 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-64e53e7e-bab4-4e2d-adfe-187de1706913 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1261 microversion: 2.1 time: 0.080525 Aug 01 16:57:47.638980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:47 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:47.898606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:47.899153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:47.905673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:47.906150 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:47.906923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:47.907384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:48.038729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:48.046551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1e1e769d-c2c9-489c-a60f-4b751c939d5c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1511 microversion: 2.1 time: 0.151814 Aug 01 16:57:48.047110 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 163/321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:47 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:48.659247 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:48.659850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:48.665761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:48.669138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:48.669138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:48.669138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:48.729883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:48.737761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ab0a7cea-5ff6-493a-89a7-6772de532d6a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1261 microversion: 2.1 time: 0.082277 Aug 01 16:57:48.738728 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:48 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:49.067965 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:49.068608 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:49.075816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:49.076265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:49.077028 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:49.077464 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:49.233652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:49.241550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fcb9aa79-b980-4838-b0d3-e58f1962a325 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1511 microversion: 2.1 time: 0.177488 Aug 01 16:57:49.242173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 164/323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:49 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:49.759555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:49.760203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:49.766754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:49.767201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:49.768100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:49.768519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:49.835939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:49.843694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2010f391-f4df-4b6c-902a-c8575ab656f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1253 microversion: 2.1 time: 0.088358 Aug 01 16:57:49.844789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 160/324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:49 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1253 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:50.262811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:50.263422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:50.270745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:50.271193 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:50.271960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:50.272393 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:50.406530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:50.413886 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4dfe494c-52cc-484a-a51a-fb25c943884a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1517 microversion: 2.1 time: 0.155080 Aug 01 16:57:50.414477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:50 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:50.871750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:50.872447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:50.879229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:50.879840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:50.882467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:50.882467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:50.949390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:50.958202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cc520f10-3a93-44e1-9029-c5d2100aef19 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1327 microversion: 2.1 time: 0.092630 Aug 01 16:57:50.959184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 161/326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:50 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:51.981084 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:51.982810 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:51.991738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:51.993859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:51.993859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:51.994433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:52.223654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:52.232674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0ebad14f-4788-4d1a-af6d-1611d4420917 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.256471 Aug 01 16:57:52.233253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 166/327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:51 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:53.258682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:53.259941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:53.260145 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ad037f86-55ec-4b80-a1fa-1456eefc6112 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: .version_select at 0x7f733f6e9820>, body: {"keypair": {"name": "tempest-keypair-144750340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvyT7lb+GywOeQgQ7gh+BnsYPe8VzITSAHU+5hezof7UlzXh+YlEVVWBKt/TDOG6sBcSUbCaXqyUI1JRUigTryrogp2wwmgVHnw5vgfjJ3Ml+nHFd+H4E6nEEGZUR18pg=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:53.273424 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:53.274974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:53.276147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:53.276535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ad037f86-55ec-4b80-a1fa-1456eefc6112 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for project 64929e340dae4c0f90162702aab5bc21. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:57:53.277078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:53.281986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ad037f86-55ec-4b80-a1fa-1456eefc6112 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for user b353fdd302394227987a6ae8c2943173 and project 64929e340dae4c0f90162702aab5bc21. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:57:53.412287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ad037f86-55ec-4b80-a1fa-1456eefc6112 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156334 Aug 01 16:57:53.413218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 167/328] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 16:57:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:57:53.473117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:53.481417 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-daf2c227-573c-4dca-ad6d-c17334c0781a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.226390 Aug 01 16:57:53.486810 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 162/329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:53 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:54.503402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:54.504106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:54.511834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:54.512293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:54.513072 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:54.513512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:54.702331 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:54.710820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-41d7be23-5d0c-4e7b-a78b-bb73f450f3d5 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.211270 Aug 01 16:57:54.711406 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 168/330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:54 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:55.732722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:55.733391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:55.735434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:55.740168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:55.742442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:55.742442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:55.742442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:55.875514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:55.883943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ee0346fa-0bfd-4a4b-8ddc-f8e810be6990 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.155027 Aug 01 16:57:55.892233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 163/331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:55 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:56.245430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1190123516", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d60261e2-2b1c-4ad0-8e3b-3707f4083506"}], "security_groups": [{"name": "tempest-securitygroup--78788817"}], "key_name": "tempest-keypair-144750340", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:57:56.254048 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:56.908418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:56.909133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:56.915495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:56.915946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:56.916720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:56.917154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:57.063303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:57.071849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-04f353c6-8e86-41df-890d-c5d3a1341d62 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.170414 Aug 01 16:57:57.072797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 164/332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:56 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:57:58.092688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:58.093353 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:58.099222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:58.099661 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:58.100407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:58.100835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:58.118343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:58.232713 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:58.236953 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2dc0c8a6-79fb-448b-b801-9376fed4e227 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.148238 Aug 01 16:57:58.237779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 165/333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:58 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:57:59.259130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:57:59.260514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:57:59.267606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:59.268833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:59.270052 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:57:59.270840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:57:59.428125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:57:59.434689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c27eb53a-13ef-4b9e-94eb-1051dc191517 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.179562 Aug 01 16:57:59.435261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 166/334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:57:59 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:00.455959 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:00.457494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:00.465341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:00.466164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:00.469106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:00.469106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:00.600718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:00.608750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bd5c78a9-2799-413d-a810-777998c147f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.155928 Aug 01 16:58:00.609378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 167/335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:00 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:01.630283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:01.630933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:01.636994 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:01.637443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:01.638242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:01.638679 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:01.789650 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:01.798427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4d77d68e-32fe-4ba8-b787-bca62dc3665c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.172111 Aug 01 16:58:01.799015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 168/336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:01 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:02.820225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:02.820901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:02.827855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:02.828309 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:02.829072 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:02.829498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:02.984484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:02.992916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-37e75abc-896f-4128-bde8-bd7abaa07296 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.176599 Aug 01 16:58:02.993496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 169/337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:02 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:03.304510 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=14 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:04.016318 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:04.016949 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:04.022940 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:04.023390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:04.024240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:04.024685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:04.166901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:04.174300 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-08632be3-026a-4b30-9104-1cefb3989f4d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.163418 Aug 01 16:58:04.178727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 170/338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:04 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:04.706471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=36 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:05.197777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:05.199254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:05.206391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:05.207775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:05.207775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:05.208380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:05.360987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:05.370472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-45317705-91d9-4888-a36c-3ea225a5be8f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.177152 Aug 01 16:58:05.387026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 171/339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:05 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:05.997969 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] validate_networks() for [('d60261e2-2b1c-4ad0-8e3b-3707f4083506', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:58:06.384237 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:58:06.384697 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:58:06.385173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:58:06.385567 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:58:06.385987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:58:06.393012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:06.393764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:06.394875 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:06.395327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:06.396133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:06.396577 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:06.400454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:06.400955 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:06.401729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:06.402365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:06.414775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:58:06.419298 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Getting quotas for user b353fdd302394227987a6ae8c2943173 and project 64929e340dae4c0f90162702aab5bc21. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:58:06.432437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:58:06.434621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:58:06.535925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:06.543463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e9dc6722-b560-4734-8386-24ccf1795235 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.154563 Aug 01 16:58:06.544024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 172/340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:06 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:06.612089 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-48744589-f8d5-4016-8649-d8275c3047e8 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 10.371327 Aug 01 16:58:06.612730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 169/341] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:57:56 2022] POST /compute/v2.1/servers => generated 407 bytes in 10373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:58:06.623711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-804a47b7-b856-4625-85c2-1356b7f019d3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:06.624470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-804a47b7-b856-4625-85c2-1356b7f019d3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:06.626302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=50 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:06.680270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-804a47b7-b856-4625-85c2-1356b7f019d3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:06.686985 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-804a47b7-b856-4625-85c2-1356b7f019d3 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1245 microversion: 2.1 time: 0.067205 Aug 01 16:58:06.687785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 173/342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:06 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:07.565328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:07.565935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:07.572369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:07.572826 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:07.573651 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:07.574058 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:07.703513 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:07.707839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:07.708447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:07.711041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7d35824a-f76b-470f-8581-88d7e8f45c0c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.151205 Aug 01 16:58:07.711615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 170/343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:07 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:07.717012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:07.717012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:07.717332 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:07.718546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:07.782423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:07.789779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5808f9e6-53d7-4e32-9070-9b689a179938 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1249 microversion: 2.1 time: 0.085721 Aug 01 16:58:07.790392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 174/344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:07 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:08.732132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:08.732745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:08.740174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:08.740866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:08.741630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:08.742081 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:08.811952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:08.813254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:08.819631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:08.820299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:08.821155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:08.821495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:08.901790 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:08.911769 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-623ef886-5a1f-48e0-88b6-fd230554e087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1297 microversion: 2.1 time: 0.103189 Aug 01 16:58:08.927358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 175/345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:08 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:08.933363 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-820cf4b6-273b-41b9-b461-a715d28be1ac req-fba7a091-a986-4f11-90e8-700b3eeaefd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:08.944218 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-820cf4b6-273b-41b9-b461-a715d28be1ac req-fba7a091-a986-4f11-90e8-700b3eeaefd5 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:08.944844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-820cf4b6-273b-41b9-b461-a715d28be1ac req-fba7a091-a986-4f11-90e8-700b3eeaefd5 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:08.957570 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-820cf4b6-273b-41b9-b461-a715d28be1ac req-fba7a091-a986-4f11-90e8-700b3eeaefd5 service nova] Creating event network-changed:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 16:58:08.962952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-820cf4b6-273b-41b9-b461-a715d28be1ac req-fba7a091-a986-4f11-90e8-700b3eeaefd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Aug 01 16:58:08.963916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 176/346] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:09.041383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:09.051111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2a211a1b-dd26-4419-a0c7-2785d76acca1 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.322672 Aug 01 16:58:09.066055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 171/347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:08 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:09.943090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:09.943794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:09.965768 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:09.966259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:09.967071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:09.968290 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:10.096117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:10.096730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:10.103880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:10.107533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:10.108377 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:10.108816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:10.119685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:10.135043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cd8f52fc-66b5-4927-8518-e2d9379a3988 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1305 microversion: 2.1 time: 0.196839 Aug 01 16:58:10.136206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:09 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:10.272029 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:10.291960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e1ea4fb6-9dd6-4e43-a5bc-4f15752b6ff9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.201257 Aug 01 16:58:10.292938 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 172/349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:10 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:11.170092 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:11.171253 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:11.181159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:11.185169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:11.185169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:11.185169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:11.317659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:11.319034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:11.322195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:11.328500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:11.329303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:11.330768 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:11.331509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:11.347468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:11.356540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bcb6907c-8445-4449-a911-8c83db12cdab tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.203126 Aug 01 16:58:11.357120 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 178/350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:11 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:11.476785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:11.485561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-844749fa-0250-4535-b205-235804f8a77e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.171688 Aug 01 16:58:11.486220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 173/351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:11 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:12.378868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:12.379494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:12.385710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:12.386205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:12.386989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:12.387427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:12.507001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:12.507609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:12.514337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:12.516213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:12.517250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:12.517694 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:12.562275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:12.570486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f2713c35-0914-4bec-ace8-f305165058a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.195511 Aug 01 16:58:12.582055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 179/352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:12 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:12.652511 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:12.660956 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f481a5d1-2530-4b93-8747-1ec6768712b3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.157846 Aug 01 16:58:12.661518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 174/353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:12 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:13.593867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:13.594550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:13.601352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:13.602687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:13.604024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:13.604594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:13.680713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:13.681938 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:13.695265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:13.696045 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:13.696985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:13.697579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:13.759931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:13.782314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-55975702-0aae-43d7-8226-d58e76094bdd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.193671 Aug 01 16:58:13.783949 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 180/354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:13 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:13.900506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:13.910994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-21b83f8c-af4e-4f57-a898-0ec6567c2c3e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.234113 Aug 01 16:58:13.911633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 175/355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:13 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:14.808865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:14.809378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:14.816546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:14.817007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:14.817780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:14.818370 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:14.932381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:14.933085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:14.940303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:14.940831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:14.941811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:14.942371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:14.955991 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:14.963634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c1e3e84e-a652-4257-a872-d969df198b9c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.158749 Aug 01 16:58:14.964205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 181/356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:14 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:15.123401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:15.131618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-faf793f7-511b-477c-a9e2-56c9931cf36a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.203121 Aug 01 16:58:15.132191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 176/357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:14 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:15.984124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:15.984766 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:15.990649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-be62f08a-053c-4283-807e-b2da4541c287 req-c78d3e4d-c411-4e13-aa82-dede35b78b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:15.991509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:15.991696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:15.992703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:15.993152 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:16.005936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-be62f08a-053c-4283-807e-b2da4541c287 req-c78d3e4d-c411-4e13-aa82-dede35b78b3f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:16.006412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-be62f08a-053c-4283-807e-b2da4541c287 req-c78d3e4d-c411-4e13-aa82-dede35b78b3f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:16.019470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-be62f08a-053c-4283-807e-b2da4541c287 req-c78d3e4d-c411-4e13-aa82-dede35b78b3f service nova] Creating event network-changed:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 16:58:16.025948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-be62f08a-053c-4283-807e-b2da4541c287 req-c78d3e4d-c411-4e13-aa82-dede35b78b3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041389 Aug 01 16:58:16.026889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 177/358] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:16.132750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:16.140263 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ee591507-1a16-448b-9c21-86b6fc52fa63 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.160059 Aug 01 16:58:16.140908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 182/359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:15 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:16.154142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:16.155044 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:16.162160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:16.162801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:16.163697 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:16.164146 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:16.372872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:16.385153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c5d403f5-0cab-4eed-a431-df3f2bd6b1ef tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.235854 Aug 01 16:58:16.389261 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 178/360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:16 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:16.766860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1014055302", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "networks": [{"uuid": "b2c7e7dc-46c1-419f-8016-b8ba1b14263d"}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:16.775058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:16.824930 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] validate_networks() for [('b2c7e7dc-46c1-419f-8016-b8ba1b14263d', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:58:17.161737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:17.162888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:17.165293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:17.166081 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:17.171447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.172085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.174534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.174534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.256800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:58:17.258396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:58:17.259360 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:58:17.260523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:58:17.261162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:58:17.275711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.277276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.279830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.281527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.309010 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Getting quotas for project 025776af0f594ddc9bfd2eedb6eb7602. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:58:17.316538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Getting quotas for user d720864cb0854d549c05e425bffafa86 and project 025776af0f594ddc9bfd2eedb6eb7602. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:58:17.321976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:17.326071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:58:17.329420 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:58:17.331093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-deda679d-e21b-441d-b637-0c57d66febf7 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.173341 Aug 01 16:58:17.331656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 179/361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:17 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:17.407357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:17.408202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:17.415814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.415814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.416023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:17.416523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:17.441897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [e4a2dc85-ed32-42f8-96bb-96057c283756] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:58:17.561746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:17.569362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9152ffa5-958c-42b4-80b2-8ed6031e8c04 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.166463 Aug 01 16:58:17.569938 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 180/362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:17 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:18.359836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:18.360521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:18.367482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:18.367920 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:18.368880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:18.369308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:18.449251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [e4a2dc85-ed32-42f8-96bb-96057c283756] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49078. Aug 01 16:58:18.453899 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1dc5bac2-7d7a-444a-95b6-858eb1cd738a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691781 Aug 01 16:58:18.454601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 183/363] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:58:18.465279 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-063f843b-6799-4551-8e71-6db108a3f985 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:18.465933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-063f843b-6799-4551-8e71-6db108a3f985 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:18.507383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:18.516619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2b854bb9-d0a6-42d8-be0b-fe5e2aee3f0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.161408 Aug 01 16:58:18.517654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 181/364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:18 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:18.529233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-063f843b-6799-4551-8e71-6db108a3f985 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:18.536879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-063f843b-6799-4551-8e71-6db108a3f985 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1219 microversion: 2.1 time: 0.075286 Aug 01 16:58:18.538431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 184/365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:18 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:18.591017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:18.591633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:18.598467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:18.599535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:18.600329 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:18.600726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:18.729979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:18.737479 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0fd71df0-6c55-4df3-9357-bc435bb81e11 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.150332 Aug 01 16:58:18.738091 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 182/366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:18 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:19.536947 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:19.537566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:19.544333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.544781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.545538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.546644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.558580 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:19.559196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:19.564666 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:19.566366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.566816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.567639 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.568082 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.634255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:19.641127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c45b6e40-a130-4f0e-930c-706c0b32f79c tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1223 microversion: 2.1 time: 0.086421 Aug 01 16:58:19.642186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 183/367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:19 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:19.680457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:19.687957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f4393cdc-5359-4e85-b3ad-94bcaef0344b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.155043 Aug 01 16:58:19.688523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 185/368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:19 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:19.758595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:19.759198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:19.765372 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.765814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.766588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:19.767089 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:19.894302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:19.901644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5db4dbd3-e806-4157-bd8b-27c561b434ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.146848 Aug 01 16:58:19.902225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 184/369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:19 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:20.230577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-08b950d9-ea62-48ac-bb42-2feaa18dff30 req-97ef6243-7d0e-4a46-8c5f-068739f46b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "name": "network-vif-plugged", "status": "completed", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:20.240275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-08b950d9-ea62-48ac-bb42-2feaa18dff30 req-97ef6243-7d0e-4a46-8c5f-068739f46b14 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.240982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-08b950d9-ea62-48ac-bb42-2feaa18dff30 req-97ef6243-7d0e-4a46-8c5f-068739f46b14 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.251842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-08b950d9-ea62-48ac-bb42-2feaa18dff30 req-97ef6243-7d0e-4a46-8c5f-068739f46b14 service nova] Creating event network-vif-plugged:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 16:58:20.256740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-08b950d9-ea62-48ac-bb42-2feaa18dff30 req-97ef6243-7d0e-4a46-8c5f-068739f46b14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029846 Aug 01 16:58:20.257314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 186/370] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:20.661972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:20.662614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:20.669175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.669627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.670423 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.671004 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.708951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:20.709780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:20.716139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.716595 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.717362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.717882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.734597 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:20.742278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-599b70b1-354c-4642-925f-fc211333979a tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1223 microversion: 2.1 time: 0.084317 Aug 01 16:58:20.742836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 185/371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:20 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:20.846803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:20.854148 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-531ff43f-c79b-4494-9119-1c1b0c1c3e36 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.149451 Aug 01 16:58:20.854719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 187/372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:20 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:20.924455 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:20.925068 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:20.931093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.931533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:20.932328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:20.932816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:21.058655 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:21.062755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:21.067246 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04a00c77-3e63-4511-854f-fec18f0c1dd0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.147695 Aug 01 16:58:21.067805 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 186/373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:20 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:21.763980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:21.765095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:21.771145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:21.771596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:21.772362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:21.772798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:21.834555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:21.841867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5a7820bf-53cc-4f90-977d-1aebc2ab02a8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1223 microversion: 2.1 time: 0.081736 Aug 01 16:58:21.842466 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 188/374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:21 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:21.876674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:21.877287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:21.883372 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:21.883822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:21.884585 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:21.885022 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:22.015649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:22.023121 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ac62e1c6-df51-436e-bcdd-8787300690d2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.151201 Aug 01 16:58:22.023696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 187/375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:21 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:22.087989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:22.088623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:22.094448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:22.094888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:22.095644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:22.096079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:22.224531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:22.231851 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a0a97fb2-4102-43e1-9d63-873d30bb49e3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.147665 Aug 01 16:58:22.236345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 189/376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:22 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:22.863471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:22.864085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:22.870367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:22.870824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:22.871576 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:22.872105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:22.941241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:22.948901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5eb015c9-ec68-4352-8092-55c0edfd8075 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1223 microversion: 2.1 time: 0.090017 Aug 01 16:58:22.949513 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 188/377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:22 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:23.048405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:23.049624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:23.056684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.057163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:23.063102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.063102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:23.192951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:23.200472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a02d9955-b1f0-4c17-98c3-f06cd4925524 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.159141 Aug 01 16:58:23.201033 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 190/378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:23 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:23.253563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:23.254220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:23.260119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.260566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:23.261317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.261750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:23.392171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:23.399590 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0be0b583-a8ce-446e-825f-b4f42bde5d9c tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.150702 Aug 01 16:58:23.400163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 189/379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:23 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:23.971774 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:23.972385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:23.979257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.980530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:23.980530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:23.980874 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.044541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:24.052249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-75c1af93-c24c-4585-bf6b-a70cbe16e7bd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1271 microversion: 2.1 time: 0.085046 Aug 01 16:58:24.052793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 191/380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:23 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:24.220912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:24.221526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:24.227887 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:24.228279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.229044 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:24.229483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.358355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:24.366242 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f3ab5018-9b7e-4e8a-8c95-b0f05984ec70 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.149060 Aug 01 16:58:24.366817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 190/381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:24 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:24.420633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:24.421269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:24.427245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:24.427691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.428445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:24.428879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.561138 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-40c91995-bf00-4678-b3c5-f949e9d9772f req-c6bf6444-332e-4271-add9-ff43e4bcbddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "name": "network-vif-plugged", "status": "completed", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:24.569025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:24.572518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-40c91995-bf00-4678-b3c5-f949e9d9772f req-c6bf6444-332e-4271-add9-ff43e4bcbddf service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:24.573093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-40c91995-bf00-4678-b3c5-f949e9d9772f req-c6bf6444-332e-4271-add9-ff43e4bcbddf service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:24.576388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-63ca8d5e-ade1-47d0-a199-789ae218b705 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.159561 Aug 01 16:58:24.576969 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 192/382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:24 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:24.584180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-40c91995-bf00-4678-b3c5-f949e9d9772f req-c6bf6444-332e-4271-add9-ff43e4bcbddf service nova] Creating event network-vif-plugged:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 16:58:24.592122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-40c91995-bf00-4678-b3c5-f949e9d9772f req-c6bf6444-332e-4271-add9-ff43e4bcbddf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 Aug 01 16:58:24.592770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 191/383] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:58:25.080998 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:25.082550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:25.088867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.089327 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.090209 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.090552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.174905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:25.183697 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b017c5fd-dd29-4ed9-bd84-eb43b774f20f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1279 microversion: 2.1 time: 0.107301 Aug 01 16:58:25.185463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:25 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:25.389240 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:25.389880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:25.396059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.396506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.397382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.397847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.530512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:25.537985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-35189b73-cf91-4cc4-afda-a22ab0f3bc9a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.154454 Aug 01 16:58:25.538587 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 192/385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:25 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:25.598266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:25.598908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:25.605175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.605614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.606413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:25.606838 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:25.753101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:25.764712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b48c6f09-0cc0-4273-b6b0-478becd85d92 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1357 microversion: 2.1 time: 0.167209 Aug 01 16:58:25.764712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 194/386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:25 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:26.207588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:26.208110 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:26.214114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.214560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.215317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.215752 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.284600 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:26.294860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f8cc22f5-e6c0-4257-a467-3e842bf6f47b tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1289 microversion: 2.1 time: 0.091604 Aug 01 16:58:26.295904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 193/387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:26 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:26.559388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:26.559998 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:26.566682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.567310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.568074 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.568516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.698478 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:26.706410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ee9e2b8d-596d-4c5d-b9d4-43f0b2e90166 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1369 microversion: 2.1 time: 0.150871 Aug 01 16:58:26.706980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 195/388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:26 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:26.782623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:26.783276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:26.789652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.790131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.790892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.791327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.923681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:26.931250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c36eef16-c95a-45d6-8681-3dd2a4a85720 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1547 microversion: 2.1 time: 0.152792 Aug 01 16:58:26.931829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 194/389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:26 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:26.952308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:26.954302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:26.958960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.959403 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:26.960215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:26.960593 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.107682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:27.116701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dc515f18-b855-4e32-a12a-cb3e231216e2 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1547 microversion: 2.1 time: 0.168097 Aug 01 16:58:27.118056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 196/390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:26 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:27.137130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:27.142236 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:27.142989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Searching by: {'deleted': False, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67'} {{(pid=124837) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 16:58:27.150191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.150635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.151422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.151847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.241846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.multi_cell_list [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124837) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 16:58:27.316618 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:27.317226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:27.319171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:27.324559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.325245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.326011 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.326543 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.337890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0c0ee093-3ec8-4061-b875-c3e373683d3f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204621 Aug 01 16:58:27.338605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 195/391] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 1 16:58:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:27.350556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:27.351173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:27.357275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.357733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.358561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.358973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.458962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:27.466756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-007a2da9-2ad7-4b1c-be33-e3d70bca8c2e tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.153994 Aug 01 16:58:27.467328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 197/392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:27 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:27.581235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:27.592260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e9edf9c4-0a87-4b2d-9612-b017b73cde64 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1547 microversion: 2.1 time: 0.245503 Aug 01 16:58:27.593048 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 196/393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:27 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1547 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:27.726313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:27.726927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:27.733552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.733713 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.734486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.735210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.762675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-8f9dc9a4-7cee-4c81-9a3a-b3fad1fe910d req-50955791-ae77-40ea-ba71-4d6e5d324844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9fda3-454e-4f0d-b705-43ded5126ae1", "tag": "e4031536-c069-48be-8afc-a36a5880a429"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:27.774162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8f9dc9a4-7cee-4c81-9a3a-b3fad1fe910d req-50955791-ae77-40ea-ba71-4d6e5d324844 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.774725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8f9dc9a4-7cee-4c81-9a3a-b3fad1fe910d req-50955791-ae77-40ea-ba71-4d6e5d324844 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.789436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-8f9dc9a4-7cee-4c81-9a3a-b3fad1fe910d req-50955791-ae77-40ea-ba71-4d6e5d324844 service nova] Creating event network-changed:e4031536-c069-48be-8afc-a36a5880a429 for instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 on hv-cinder-84989 Aug 01 16:58:27.795140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-8f9dc9a4-7cee-4c81-9a3a-b3fad1fe910d req-50955791-ae77-40ea-ba71-4d6e5d324844 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035954 Aug 01 16:58:27.795752 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 197/394] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:58:27.887428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:27.895768 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b53bad8e-f6f1-4b60-8b66-1b75a2f80b71 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1563 microversion: 2.1 time: 0.173326 Aug 01 16:58:27.896349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 198/395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:27 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:27.916730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:27.917312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:27.923628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.924077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:27.924835 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:27.925270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:28.007501 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4895c85a-98a7-4a56-b454-104dc1107ac5 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094916 Aug 01 16:58:28.010213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 198/396] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 16:58:27 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:28.489004 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:28.489615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:28.496027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:28.496470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:28.497266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:28.497704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:28.534473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=8 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:28.640454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:28.648748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e6d71ba0-7443-471a-9dde-26cf51f502e1 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.164460 Aug 01 16:58:28.649330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 199/397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:28 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:29.275893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:58:29.276907 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 16:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:58:29.670963 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:29.671609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:29.677994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:29.678466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:29.679239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:29.679666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:29.812594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-c7afe58a-a332-417f-8b09-6d7ece738f37 req-fd3d864f-0e61-4d7d-a456-bce5262feb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:29.818861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:29.822743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c7afe58a-a332-417f-8b09-6d7ece738f37 req-fd3d864f-0e61-4d7d-a456-bce5262feb3e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:29.823502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c7afe58a-a332-417f-8b09-6d7ece738f37 req-fd3d864f-0e61-4d7d-a456-bce5262feb3e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:29.827430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a3dd9167-a14b-4dbb-b28a-0ba0fc6b6786 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.160925 Aug 01 16:58:29.828087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 199/398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:29 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:29.835627 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-c7afe58a-a332-417f-8b09-6d7ece738f37 req-fd3d864f-0e61-4d7d-a456-bce5262feb3e service nova] Creating event network-changed:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 16:58:29.840977 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-c7afe58a-a332-417f-8b09-6d7ece738f37 req-fd3d864f-0e61-4d7d-a456-bce5262feb3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Aug 01 16:58:29.845216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 200/399] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:58:30.509996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35b96ba9-bfa9-489b-9846-9eaea368c86b"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:30.512450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:30.519293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:30.519729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:30.520499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:30.520931 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:30.849796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:30.850587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:30.856728 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:30.857179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:30.857934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:30.858395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:31.003944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:31.010166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-496b3ed0-cfe1-48fc-9643-9c5ad9e6c873 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.164550 Aug 01 16:58:31.010723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 201/400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:30 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:32.031847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:32.032632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:32.042913 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:32.043363 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:32.045249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:32.047199 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:32.201380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:32.210249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fffc4287-ea85-40ca-a730-0f94a13af9f8 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.182195 Aug 01 16:58:32.210827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 202/401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:32 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:33.243894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:33.244509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:33.250577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:33.251024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:33.251793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:33.252225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:33.274503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:33.400442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:33.411222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6f5b3af4-69c0-45fe-913f-8fef8ba8649f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.168314 Aug 01 16:58:33.411222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 203/402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:33 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:33.786339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8678670f-94f0-4fc7-8fcf-8c6d46140558 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.280193 Aug 01 16:58:33.787017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 200/403] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 16:58:30 2022] POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments => generated 194 bytes in 3282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:34.428681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:34.429281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:34.435826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:34.436270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:34.437338 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:34.437455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:34.575888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:34.583906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-652b1fc2-dd87-4851-a2f2-bcaa18cd6438 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.159064 Aug 01 16:58:34.584464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 204/404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:34 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:35.605685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:35.606408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:35.612893 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:35.613349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:35.614129 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:35.614563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:35.741531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:35.749349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-71919e4a-3b2a-434c-8742-4bf3862a4a10 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.148332 Aug 01 16:58:35.750094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 201/405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:35 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:36.633286 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-bb0b3560-8c06-4245-ad18-0796f50b31da req-90756906-8add-4dcb-890b-69e6457c8e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9fda3-454e-4f0d-b705-43ded5126ae1", "name": "network-vif-plugged", "status": "completed", "tag": "e4031536-c069-48be-8afc-a36a5880a429"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:36.642707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-bb0b3560-8c06-4245-ad18-0796f50b31da req-90756906-8add-4dcb-890b-69e6457c8e1e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:36.642937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-bb0b3560-8c06-4245-ad18-0796f50b31da req-90756906-8add-4dcb-890b-69e6457c8e1e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:36.654529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-bb0b3560-8c06-4245-ad18-0796f50b31da req-90756906-8add-4dcb-890b-69e6457c8e1e service nova] Creating event network-vif-plugged:e4031536-c069-48be-8afc-a36a5880a429 for instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 on hv-cinder-84989 Aug 01 16:58:36.660734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-bb0b3560-8c06-4245-ad18-0796f50b31da req-90756906-8add-4dcb-890b-69e6457c8e1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Aug 01 16:58:36.661374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 205/406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:36.771461 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:36.772071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:36.778637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:36.779075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:36.779932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:36.780242 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:36.917800 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:36.925502 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0b3abd71-4f07-4f2b-8f27-8405faa90536 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.158465 Aug 01 16:58:36.926109 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 202/407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:36 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:37.946691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:37.951509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:37.951509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:37.955087 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:37.955538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:37.957170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:37.957490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:38.090944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:38.099260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-70bac288-5892-4a24-b7b6-5fb8acd25efd tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1319 microversion: 2.1 time: 0.156856 Aug 01 16:58:38.100015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 206/408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:37 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:39.125945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:39.127343 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:39.129610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:39.147755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:39.148302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:39.149279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:39.149973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:39.169879 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:39.285438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:39.292616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-73a27032-ffc8-49b9-b386-1ff3b19ab9d3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1509 microversion: 2.1 time: 0.170683 Aug 01 16:58:39.293176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 203/409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:39 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:41.842879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-952484520", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:41.895094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] validate_networks() for None {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:58:42.175561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:58:42.176038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:58:42.176600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:58:42.177024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:58:42.177442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:58:42.187027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:42.187480 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:42.188282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:42.188722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:42.206583 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Getting quotas for project ce67b7a6f3034531936a300a6a3cdc90. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:58:42.211215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Getting quotas for user 0320d6dd02b54fcca5ac1240b5eff961 and project ce67b7a6f3034531936a300a6a3cdc90. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:58:42.222183 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:58:42.224480 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:58:42.366892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6ffb11b8-1cec-4d5a-a7b0-f436010fac42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528354 Aug 01 16:58:42.367864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 207/410] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 16:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:58:42.380180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-502a49a9-f6ce-4fba-a326-722ee4a5a13c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:42.380858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-502a49a9-f6ce-4fba-a326-722ee4a5a13c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:42.383232 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=62 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:42.438330 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-502a49a9-f6ce-4fba-a326-722ee4a5a13c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:42.446776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-502a49a9-f6ce-4fba-a326-722ee4a5a13c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1214 microversion: 2.1 time: 0.071869 Aug 01 16:58:42.447345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 204/411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:42 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:42.461204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:42.461823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:42.468665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:42.469117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:42.470637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:42.471171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:42.615632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:42.623777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d5ec26c1-556f-49ef-86a9-e252324824a6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1593 microversion: 2.1 time: 0.167060 Aug 01 16:58:42.624342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 208/412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:42 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:43.467704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:43.468459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:43.476888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:43.477483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:43.478419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:43.478930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:43.579570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:43.596986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a78acea9-e2dd-4b0a-a04c-9c0be6ae2313 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1218 microversion: 2.1 time: 0.133027 Aug 01 16:58:43.601076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:43 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:44.625585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:44.626191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:44.632653 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:44.633100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:44.633879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:44.634344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:44.705537 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:44.714207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5b55f1e1-4ad9-4d03-bf1d-656cfa73493e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1274 microversion: 2.1 time: 0.092415 Aug 01 16:58:44.714778 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 209/414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:44 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:45.257538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-f56d2c98-e7c8-497c-8581-32ff43fd79d3 req-af627685-fbb9-4e76-84c0-669876b8f2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:45.267845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f56d2c98-e7c8-497c-8581-32ff43fd79d3 req-af627685-fbb9-4e76-84c0-669876b8f2de service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:45.268375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f56d2c98-e7c8-497c-8581-32ff43fd79d3 req-af627685-fbb9-4e76-84c0-669876b8f2de service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:45.282238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-f56d2c98-e7c8-497c-8581-32ff43fd79d3 req-af627685-fbb9-4e76-84c0-669876b8f2de service nova] Creating event network-changed:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 16:58:45.287576 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-f56d2c98-e7c8-497c-8581-32ff43fd79d3 req-af627685-fbb9-4e76-84c0-669876b8f2de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 Aug 01 16:58:45.288170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 206/415] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:45.739049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:45.743596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:45.756987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:45.756987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:45.756987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:45.756987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:45.848794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:45.859422 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6d026ad1-b1f8-47f5-be1d-b28e389f21b1 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1272 microversion: 2.1 time: 0.124653 Aug 01 16:58:45.860580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 210/416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:45 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:46.884751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:46.885668 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:46.892456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:46.892902 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:46.893672 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:46.894132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:47.068560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:47.077269 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5cab4343-2d73-4385-80de-41bd48ad33f9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.197534 Aug 01 16:58:47.078392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:46 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:47.307064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-fdc107c9-4df5-4ba9-a85c-92f02012970b req-8001d10a-ad75-4d5d-ba4a-6433aa6a4483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f5f64c-c61b-4816-8968-3be050e51bb8", "tag": "7930da51-4abf-4806-bc54-621c17d36948"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:47.324301 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-fdc107c9-4df5-4ba9-a85c-92f02012970b req-8001d10a-ad75-4d5d-ba4a-6433aa6a4483 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:47.324301 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-fdc107c9-4df5-4ba9-a85c-92f02012970b req-8001d10a-ad75-4d5d-ba4a-6433aa6a4483 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:47.335616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-fdc107c9-4df5-4ba9-a85c-92f02012970b req-8001d10a-ad75-4d5d-ba4a-6433aa6a4483 service nova] Creating event network-changed:7930da51-4abf-4806-bc54-621c17d36948 for instance b0f5f64c-c61b-4816-8968-3be050e51bb8 on hv-cinder-84989 Aug 01 16:58:47.340793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-fdc107c9-4df5-4ba9-a85c-92f02012970b req-8001d10a-ad75-4d5d-ba4a-6433aa6a4483 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Aug 01 16:58:47.341845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 211/418] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:47.993135 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1408294343"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:47.993730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:48.001924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.005075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.005075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.005075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.099294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:48.100009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:48.106235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.106688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.107451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.107886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.135574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.network.security_group_api [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Adding security group bf2694ec-fd0b-42d0-8a03-5b17c6797c02 to port 6ce55c64-693a-4185-b2a9-7c3b3f6a4436 Aug 01 16:58:48.249108 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:48.257154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2a26e426-0bb1-4748-9c79-a1f10b493012 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.162521 Aug 01 16:58:48.257728 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 212/419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:48 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:48.524808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1520abaf-ec06-4eae-8724-427f97ba2969 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action" status: 202 len: 0 microversion: 2.1 time: 0.537088 Aug 01 16:58:48.525427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 208/420] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:58:47 2022] POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:58:48.539079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:48.539910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:48.546257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.546866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.547871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:48.548429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:48.707362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:48.716299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6adf9985-427a-436d-a060-2b9ee56913c3 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1759 microversion: 2.1 time: 0.182099 Aug 01 16:58:48.716883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 213/421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:48 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:49.278054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:49.278670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:49.284917 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:49.285360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:49.286133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:49.287259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:49.372217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-f11b6804-e254-4e43-8dbd-7c346ac6f10e req-5dd8a624-ca3d-400d-bf0e-c0c5f4d45181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:49.382210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-f11b6804-e254-4e43-8dbd-7c346ac6f10e req-5dd8a624-ca3d-400d-bf0e-c0c5f4d45181 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:49.382842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-f11b6804-e254-4e43-8dbd-7c346ac6f10e req-5dd8a624-ca3d-400d-bf0e-c0c5f4d45181 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:49.394105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-f11b6804-e254-4e43-8dbd-7c346ac6f10e req-5dd8a624-ca3d-400d-bf0e-c0c5f4d45181 service nova] Creating event network-changed:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 16:58:49.400661 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-f11b6804-e254-4e43-8dbd-7c346ac6f10e req-5dd8a624-ca3d-400d-bf0e-c0c5f4d45181 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032068 Aug 01 16:58:49.401834 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 214/422] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:58:49.428568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:49.436047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-914b2c34-873c-4ca6-ab31-6f55caf4e4e9 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.162342 Aug 01 16:58:49.436605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 209/423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:49 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:50.458160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:50.458975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:50.466807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:50.467250 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:50.468019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:50.468447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:50.609175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:50.616888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-57d0b713-b5e2-41c6-b829-7d0f4cd07002 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.163075 Aug 01 16:58:50.617450 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 215/424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:50 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:51.639595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:51.640206 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:51.646723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:51.647169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:51.647934 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:51.648366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:51.777072 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:51.784406 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a47a2374-0b8f-44a9-815a-1389530e451a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.148705 Aug 01 16:58:51.784966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 210/425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:51 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:52.804943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:52.806493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:52.808462 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:52.809119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:52.813979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:52.818680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:52.818680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:52.818680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:52.948951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:52.956936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ef124d0f-55d5-4331-9527-4134eabcee07 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.155960 Aug 01 16:58:52.957502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 216/426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:52 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:53.977874 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:53.978466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:53.980401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:58:53.985822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:53.986292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:53.987072 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:53.987502 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:54.117152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:54.125025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9da17950-7a91-4874-9c41-efa74676a63a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.151673 Aug 01 16:58:54.125605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 211/427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:53 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:55.115515 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-005440a2-e7ea-4b66-93e6-4b3d78e8c054 req-43ae0e37-01bb-411e-8b45-99ae74779525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f5f64c-c61b-4816-8968-3be050e51bb8", "name": "network-vif-plugged", "status": "completed", "tag": "7930da51-4abf-4806-bc54-621c17d36948"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:58:55.126234 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-005440a2-e7ea-4b66-93e6-4b3d78e8c054 req-43ae0e37-01bb-411e-8b45-99ae74779525 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:55.126782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-005440a2-e7ea-4b66-93e6-4b3d78e8c054 req-43ae0e37-01bb-411e-8b45-99ae74779525 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:55.138879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-005440a2-e7ea-4b66-93e6-4b3d78e8c054 req-43ae0e37-01bb-411e-8b45-99ae74779525 service nova] Creating event network-vif-plugged:7930da51-4abf-4806-bc54-621c17d36948 for instance b0f5f64c-c61b-4816-8968-3be050e51bb8 on hv-cinder-84989 Aug 01 16:58:55.144575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-005440a2-e7ea-4b66-93e6-4b3d78e8c054 req-43ae0e37-01bb-411e-8b45-99ae74779525 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Aug 01 16:58:55.145264 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:55.145738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 217/428] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:58:55.145955 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:55.152269 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:55.152718 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:55.153482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:55.153920 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:55.289000 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:55.297518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0dcc214-671b-4db9-bd04-ab87625d3382 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.156046 Aug 01 16:58:55.298136 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 212/429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:55 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:58:56.319116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:56.319818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:56.326850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:56.327295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:56.328050 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:56.328484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:56.457926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:56.466677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6084fee8-1b2f-4d05-a334-943d17a34b42 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.151607 Aug 01 16:58:56.467258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 218/430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:56 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:57.487978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:57.488587 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:57.495358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:57.495806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:57.496564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:57.496998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:57.624465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:57.631800 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f43bedb0-dd38-4a8e-ad91-4291f3abbe35 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1314 microversion: 2.1 time: 0.147666 Aug 01 16:58:57.632368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 213/431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:57 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:58.653132 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:58.653794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:58.659794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:58.660231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:58.660974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:58.661406 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:58.795903 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:58.803245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6fe40f3b-533d-48ab-927e-3542cefc68f8 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1463 microversion: 2.1 time: 0.154240 Aug 01 16:58:58.803804 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 219/432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:58 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:58:58.847414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:58.847899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:58.855282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:58.855728 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:58.856483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:58.856907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:58.883762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:58:59.175320 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-86a92eec-f3b7-4f1e-8c33-7979dd352d1e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 204 len: 0 microversion: 2.1 time: 0.331322 Aug 01 16:58:59.175925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 214/433] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 16:58:58 2022] DELETE /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:58:59.184187 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:58:59.184871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:58:59.190995 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:59.191444 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:59.192206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:58:59.192672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:58:59.319097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:58:59.327111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9fb75cb1-d11e-4b9c-8f21-93ab3323260b tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1469 microversion: 2.1 time: 0.146905 Aug 01 16:58:59.327699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 220/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:58:59 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:00.349134 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:00.349840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:00.356673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:00.357124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:00.357883 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:00.358346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:00.489085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:00.498506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4c522737-cc1f-495a-ae1f-6f8d29993c1a tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1469 microversion: 2.1 time: 0.153548 Aug 01 16:59:00.499080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 215/435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:00 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:01.520078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:01.520718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:01.527568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:01.528026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:01.528787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:01.529223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:01.765592 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:01.773103 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0f0e66b2-b4c4-4d9f-977b-77d6e35a581e tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1469 microversion: 2.1 time: 0.256814 Aug 01 16:59:01.773608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 221/436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:01 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:02.191980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7206c84f-739f-41a4-b8b4-08d24fd223de req-f725fa1b-21c4-41e9-b09c-ec937a23a617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f5f64c-c61b-4816-8968-3be050e51bb8", "name": "network-vif-deleted", "tag": "7930da51-4abf-4806-bc54-621c17d36948"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:02.204918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7206c84f-739f-41a4-b8b4-08d24fd223de req-f725fa1b-21c4-41e9-b09c-ec937a23a617 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:02.205369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7206c84f-739f-41a4-b8b4-08d24fd223de req-f725fa1b-21c4-41e9-b09c-ec937a23a617 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:02.223063 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7206c84f-739f-41a4-b8b4-08d24fd223de req-f725fa1b-21c4-41e9-b09c-ec937a23a617 service nova] Creating event network-vif-deleted:7930da51-4abf-4806-bc54-621c17d36948 for instance b0f5f64c-c61b-4816-8968-3be050e51bb8 on hv-cinder-84989 Aug 01 16:59:02.228931 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7206c84f-739f-41a4-b8b4-08d24fd223de req-f725fa1b-21c4-41e9-b09c-ec937a23a617 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040261 Aug 01 16:59:02.229898 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 216/437] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:59:02.794337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:02.794950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:02.800954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:02.801400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:02.802187 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:02.802621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:02.832667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:02.833109 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:02.833547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lazy-loading 'fault' on Instance uuid b0f5f64c-c61b-4816-8968-3be050e51bb8 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:59:02.875174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0320d6dd02b54fcca5ac1240b5eff961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce67b7a6f3034531936a300a6a3cdc90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:02.882797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6ea2ff50-fb4b-4622-9d9b-7118914d176c tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 200 len: 1304 microversion: 2.1 time: 0.092633 Aug 01 16:59:02.883547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 222/438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:02 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:03.905708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:03.906492 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] [instance: b0f5f64c-c61b-4816-8968-3be050e51bb8] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:03.913343 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:03.913791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:03.914707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:03.915151 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:03.928824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] HTTP exception thrown: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Request method failure captured: Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 HTTP/1.1 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AY-Opl-weMVJoPP0zZ2U8cViBY_auyvL6xRTa4vI0WiLx5t753O1Dx_SmRAeFs5_IrJ-7MmPd__SlC4YpmoXQ5_9RwCZNylNrlpwQMiWmCfPEMkf8abTgUkBiDnPOw-YWLDVs6OTPIv6lvBB_xrme1lL3aTtN9-7uZN5xLdYwC4lSg Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: ce67b7a6f3034531936a300a6a3cdc90 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesNegativeTest-1422720421 Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 16:59:03.930460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce67b7a6f3034531936a300a6a3cdc90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce67b7a6f3034531936a300a6a3cdc90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce67b7a6f3034531936a300a6a3cdc90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce67b7a6f3034531936a300a6a3cdc90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesNegativeTest-1422720421 Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: ce67b7a6f3034531936a300a6a3cdc90 Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesNegativeTest-1422720421 Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesNegativeTest-1422720421-project Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 0320d6dd02b54fcca5ac1240b5eff961 Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesNegativeTest-1422720421-project Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. Aug 01 16:59:03.934469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'b0f5f64c-c61b-4816-8968-3be050e51bb8'} Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:59:03.935408 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. Aug 01 16:59:03.936924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 16:59:03.938395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] Returning 404 to user: Instance b0f5f64c-c61b-4816-8968-3be050e51bb8 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:59:03.938395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ec2a375b-00f4-4e07-9ad3-c8b4e8732211 tempest-VolumesNegativeTest-1422720421 tempest-VolumesNegativeTest-1422720421-project] 10.222.0.20 "GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8" status: 404 len: 111 microversion: 2.1 time: 0.031636 Aug 01 16:59:03.938395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 217/439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:03 2022] GET /compute/v2.1/servers/b0f5f64c-c61b-4816-8968-3be050e51bb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:59:06.444169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bfb908c-5a6f-4160-8a1d-fd07411ff84e", "device": "/dev/sdb"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:06.447735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:06.453974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:06.454646 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:06.455479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:06.455848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:06.459595 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=99 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:07.293501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ade7e510-95d8-461c-bf6d-81df2e3eed30 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "POST /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853252 Aug 01 16:59:07.294294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 223/440] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 16:59:06 2022] POST /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:59:13.392256 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:13.393433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:13.396396 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:13.401229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:13.402515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:13.403295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:13.403730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:13.407736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:13.428225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b14cae4d-71ab-4162-a586-15af641eaaa9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/ips" status: 200 len: 146 microversion: 2.1 time: 0.040066 Aug 01 16:59:13.428855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 218/441] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 16:59:13 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:59:22.871792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:22.872985 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:23.053760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2a0b9261-3b3f-47f4-9c0b-928deabc62da tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Action: 'create', calling method: .version_select at 0x7f733de5a310>, body: {"keypair": {"name": "tempest-TestShelveInstance-2022994459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYUkzURrzjy3i5d0KqBTmxIhKEIWdQYkn112Z9FmN7Lh2cjGx3T56jgmnx8XWd0pLGg7vEsS5bYRFtV+LVXbWGcam1X/uzLL7Mkm925uTWS7rVTEi5qP/OPO8UMRGx1mQ=="}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:23.070282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-2a0b9261-3b3f-47f4-9c0b-928deabc62da tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Getting quotas for project 26251afa3c5e43839015776368defa1d. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:59:23.074814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-2a0b9261-3b3f-47f4-9c0b-928deabc62da tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Getting quotas for user 8c4a2a503fa14203bcf5b98bfbcccbf8 and project 26251afa3c5e43839015776368defa1d. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:59:23.150110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2a0b9261-3b3f-47f4-9c0b-928deabc62da tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278430 Aug 01 16:59:23.150110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 224/442] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 16:59:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:59:23.512645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb16fb01-bfe8-4b2a-be81-e8a158a1f1a1"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:23.515308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:23.524371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:23.524907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:23.525760 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:23.526985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:27.997661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cede577a-bc19-4ee3-b9fd-5b1704478b0e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.488891 Aug 01 16:59:27.998420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 219/443] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 16:59:23 2022] POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments => generated 194 bytes in 4491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:59:40.815005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=4 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:40.815762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:40.819776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2b0dec46-6e04-4237-b2d1-758077fb042a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:40.826538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b0dec46-6e04-4237-b2d1-758077fb042a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:40.826988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b0dec46-6e04-4237-b2d1-758077fb042a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:40.887114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2b0dec46-6e04-4237-b2d1-758077fb042a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Going to try to stop instance {{(pid=124835) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 16:59:41.013388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2b0dec46-6e04-4237-b2d1-758077fb042a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action" status: 202 len: 0 microversion: 2.1 time: 0.199416 Aug 01 16:59:41.014239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 225/444] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:59:40 2022] POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:59:41.020309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:41.028885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:41.028885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:41.028885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:41.033834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:41.034312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:41.035085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:41.035564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:41.173877 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:41.181921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1edf734c-fd3c-4643-b07b-48237b3a974b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.163115 Aug 01 16:59:41.184079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 220/445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:41 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:42.206348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:42.206965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:42.213217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:42.213663 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:42.214483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:42.214918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:42.350946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:42.360261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-06db6ab7-4889-42de-b8e3-7c1354e8e337 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.158729 Aug 01 16:59:42.360850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 226/446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:42 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:43.382789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:43.383399 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:43.390328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:43.390778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:43.393944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:43.393944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:43.521288 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:43.529958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e30568a9-e3cf-4b35-b12a-9cfe8ee9657b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.151600 Aug 01 16:59:43.530564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 221/447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:43 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:59:44.551658 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:44.552274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:44.558811 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:44.559264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:44.560329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:44.560770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:44.605059 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:44.605608 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:44.612778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:44.613225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:44.614023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:44.614483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:44.689291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:44.697377 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f1ff0304-ed5a-471d-84da-f2c239fbacff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.149663 Aug 01 16:59:44.697944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 227/448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:44 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:44.738964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lazy-loading 'services' on Instance uuid 25c9fda3-454e-4f0d-b705-43ded5126ae1 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:59:45.026220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-80fe0027-8f66-4e57-a124-5655e9d43e90 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1/os-volume_attachments/9bfb908c-5a6f-4160-8a1d-fd07411ff84e" status: 202 len: 0 microversion: 2.1 time: 0.424879 Aug 01 16:59:45.028368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 222/449] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 16:59:44 2022] DELETE /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1/os-volume_attachments/9bfb908c-5a6f-4160-8a1d-fd07411ff84e => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:59:45.718168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:45.718782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:45.725207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:45.725658 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:45.726460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:45.726898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:45.852718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:45.861198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bdd1049e-9773-472f-a44a-505935163ffd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.146860 Aug 01 16:59:45.861768 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 228/450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:45 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:46.890521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:46.891212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:46.897313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:46.897757 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:46.898546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:46.898985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:47.034435 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:47.042400 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f9f90762-ecee-44d8-b3bc-5d9e764c49ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.157418 Aug 01 16:59:47.046638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 223/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:46 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:47.203995 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:47.204506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:47.210879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:47.211331 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:47.212093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:47.212530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:47.237867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:59:47.449783 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b7b4e40b-f49e-428c-849a-c1526509d4bb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 204 len: 0 microversion: 2.1 time: 0.249261 Aug 01 16:59:47.450349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 229/452] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 16:59:47 2022] DELETE /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:59:47.458571 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:47.459182 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:47.465125 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:47.465574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:47.467540 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:47.467999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:47.595064 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:47.602422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-93b5e033-6bd6-4e70-a09c-f37e26705a70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1515 microversion: 2.1 time: 0.147747 Aug 01 16:59:47.602989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 224/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:47 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:48.063791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:48.064488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:48.070419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:48.070870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:48.071625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:48.072059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:48.203759 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:48.211687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cae757e0-6600-4213-afa1-32516526bf97 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.152161 Aug 01 16:59:48.212266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 230/454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:48 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:48.625130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:48.625749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:48.632202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:48.632643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:48.633394 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:48.633825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:48.763796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:48.771270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0cebd1c0-3b48-4d91-8937-d08ce8cff938 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1515 microversion: 2.1 time: 0.150628 Aug 01 16:59:48.771835 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 225/455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:48 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:49.233239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:49.233847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:49.240284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:49.240727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:49.241740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:49.242201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:49.371005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:49.378897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a50a4ce3-87ee-430f-88b1-475e7c9956ab tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.150091 Aug 01 16:59:49.379463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 231/456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:49 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:49.792392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:49.793012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:49.799830 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:49.800281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:49.801047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:49.801511 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:49.928238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:49.936280 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cde3023c-9056-45a2-b3aa-372abdbbb458 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1515 microversion: 2.1 time: 0.147171 Aug 01 16:59:49.936985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 226/457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:49 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:50.400511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:50.401114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:50.408206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:50.408643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:50.409390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:50.409821 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:50.545698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:50.550914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c9a6ef28-5480-4ddd-8c6d-7dc2013db1a9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.154211 Aug 01 16:59:50.551473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 232/458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:50 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:50.957249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:50.957857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:50.964420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:50.964858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:50.965616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:50.966054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:51.096654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:51.104222 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-66065922-ee89-455b-b725-6235683d5681 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1515 microversion: 2.1 time: 0.150873 Aug 01 16:59:51.107724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 227/459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:50 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:51.229292 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-7d03ff6a-945e-4d15-bd7c-2f245192fadd req-43c5283b-6625-4f9f-9869-02dbf037d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9fda3-454e-4f0d-b705-43ded5126ae1", "name": "network-vif-deleted", "tag": "e4031536-c069-48be-8afc-a36a5880a429"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:51.239083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-7d03ff6a-945e-4d15-bd7c-2f245192fadd req-43c5283b-6625-4f9f-9869-02dbf037d9d8 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:51.239708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-7d03ff6a-945e-4d15-bd7c-2f245192fadd req-43c5283b-6625-4f9f-9869-02dbf037d9d8 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:51.251341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-7d03ff6a-945e-4d15-bd7c-2f245192fadd req-43c5283b-6625-4f9f-9869-02dbf037d9d8 service nova] Creating event network-vif-deleted:e4031536-c069-48be-8afc-a36a5880a429 for instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 on hv-cinder-84989 Aug 01 16:59:51.256342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-7d03ff6a-945e-4d15-bd7c-2f245192fadd req-43c5283b-6625-4f9f-9869-02dbf037d9d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031097 Aug 01 16:59:51.257160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 233/460] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 16:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:59:51.571883 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:51.572518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:51.579670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:51.580149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:51.581070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:51.581503 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:51.715731 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:51.723900 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3956a7fe-35f1-43f4-8bf4-5a7b3afa051d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.155840 Aug 01 16:59:51.724467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 228/461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:51 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:52.127232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:52.128304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:52.136525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:52.136854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:52.137759 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:52.138407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:52.171952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:52.172313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:52.172819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lazy-loading 'fault' on Instance uuid 25c9fda3-454e-4f0d-b705-43ded5126ae1 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:59:52.218758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:52.226319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1c7ea40a-600f-4f3c-9867-763e55682030 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 200 len: 1309 microversion: 2.1 time: 0.103990 Aug 01 16:59:52.226887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:52 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:52.745761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:52.746429 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:52.753414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:52.753861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:52.754654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:52.755093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:52.882856 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:52.891099 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-335bb9f5-9e5a-4b95-92c2-cb78e0848d8f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.149109 Aug 01 16:59:52.891663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 229/463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:52 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:53.248320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:53.248962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 25c9fda3-454e-4f0d-b705-43ded5126ae1] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:53.255445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:53.255896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:53.256664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:53.257102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:53.271066 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] HTTP exception thrown: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Request method failure captured: Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 HTTP/1.1 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AYl0uFffCZ2BnA8n4SONic1i2TanDR_mhSqiYZ11XQ4w--u54xqCVXKEJO7iDwRaYQM3-fd0kgtzXfF14ZxsXu30el-JpAvdW9K60R4VqeIc8AEbt0xdIz7DpY3YT343-ZZH1yKpBgyJ1-SrNhXjlLaOlRgSAB0zkNo6rY-JqPJmDY Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 025776af0f594ddc9bfd2eedb6eb7602 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 16:59:53.272698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 025776af0f594ddc9bfd2eedb6eb7602 Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesSnapshotTestJSON-747928240-project Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: d720864cb0854d549c05e425bffafa86 Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesSnapshotTestJSON-747928240-project Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. Aug 01 16:59:53.284019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '25c9fda3-454e-4f0d-b705-43ded5126ae1'} Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:59:53.284920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. Aug 01 16:59:53.286239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 16:59:53.287671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Returning 404 to user: Instance 25c9fda3-454e-4f0d-b705-43ded5126ae1 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:59:53.287671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-03c07bc0-46fa-4531-ad32-4bef3e9084b9 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1" status: 404 len: 111 microversion: 2.1 time: 0.029881 Aug 01 16:59:53.287671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 235/464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:53 2022] GET /compute/v2.1/servers/25c9fda3-454e-4f0d-b705-43ded5126ae1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:59:53.912514 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:53.913069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:53.919489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:53.920448 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:53.921374 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:53.921813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:54.053060 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:54.061952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a6cfd892-ffdf-4b8f-9d8a-55668982e10b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.153343 Aug 01 16:59:54.062562 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 230/465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:53 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:54.876192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:54.876710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:54.883013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:54.883464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:54.884232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:54.884666 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:54.908322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7306b101-e875-4b98-9ade-d88031eda92b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037016 Aug 01 16:59:54.909336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 236/466] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 1 16:59:54 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:59:55.083257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:55.083869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:55.090586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:55.091034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:55.092594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:55.093033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:55.224569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:55.233162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f645773a-8244-4459-b6bf-11c20aa92775 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.153323 Aug 01 16:59:55.233853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 231/467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:55 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:56.254549 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:56.255162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:56.261659 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:56.262158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:56.262917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:56.263862 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:56.391940 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:56.399814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7f1ecafa-76f4-4eb0-b3e2-a46c5c190e40 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.149034 Aug 01 16:59:56.400376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 237/468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:56 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:57.421580 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:57.422125 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:57.428591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:57.429035 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:57.429821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:57.430297 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:57.656105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:57.664080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c593102e-da09-4915-8a86-14da38793402 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1724 microversion: 2.1 time: 0.247164 Aug 01 16:59:57.664640 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 232/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:57 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:58.684590 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:58.685503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:58.692205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:58.692751 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:58.693453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:58.693893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:58.823976 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:58.832148 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b7d5cbd2-21ef-41c0-a3ee-78f8da5ecf8e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1701 microversion: 2.1 time: 0.151416 Aug 01 16:59:58.832709 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 238/470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:58 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:59:58.853313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4265ab3-8f63-4869-b37d-6c3b3dea0076 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:59:58.860411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4265ab3-8f63-4869-b37d-6c3b3dea0076 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:58.860853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4265ab3-8f63-4869-b37d-6c3b3dea0076 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:58.919565 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4265ab3-8f63-4869-b37d-6c3b3dea0076 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Going to try to start instance {{(pid=124837) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 16:59:59.093341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4265ab3-8f63-4869-b37d-6c3b3dea0076 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action" status: 202 len: 0 microversion: 2.1 time: 0.243701 Aug 01 16:59:59.094003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 233/471] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 16:59:58 2022] POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:59:59.102561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:59:59.103189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:59:59.109341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:59.109796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:59.110582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:59:59.113653 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:59:59.247667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:59:59.255865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3eb02b5d-0a01-48ee-a7e8-51c5d7af3073 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1710 microversion: 2.1 time: 0.157414 Aug 01 16:59:59.256448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 239/472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 16:59:59 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:00.277616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:00.278339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:00.285589 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:00.286047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:00.286808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:00.287329 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:00.420199 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:00.424132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:00.429159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9f800990-1567-452f-967d-3de825b97cd1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1710 microversion: 2.1 time: 0.155871 Aug 01 17:00:00.429830 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 234/473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:00 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:01.451107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:01.452435 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:01.459393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:01.459837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:01.460625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:01.461056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:01.465299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:01.567662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:01.568187 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:01.575430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:01.575878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:01.576827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:01.577264 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:01.600432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lazy-loading 'flavor' on Instance uuid 2afc4567-0ddd-4f00-b501-0ee07c12677d {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:00:01.665264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:01.674628 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8ff031ff-f5d5-4c0d-ba07-435e0f31159f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1710 microversion: 2.1 time: 0.227684 Aug 01 17:00:01.675189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 240/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:01 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1710 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:02.038235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c6cd0e09-db1b-40bc-a6b4-9e8d184886f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/action" status: 202 len: 0 microversion: 2.20 time: 0.474602 Aug 01 17:00:02.038836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 235/475] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 1 17:00:01 2022] POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 17:00:02.047329 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:02.047943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:02.054340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.054779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.065222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.065222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.129594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1392446461", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2022994459", "security_groups": [{"name": "tempest-secgroup-smoke-744846313"}], "networks": [{"uuid": "661b53a4-f07f-4651-8540-371f8dcfac89"}], "block_device_mapping_v2": [{"uuid": "0322919a-ce98-4b50-bf31-c6380390de0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:02.191163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:02.199315 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:02.201429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:02.202615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-afc62e8a-aafb-4e73-a9c7-62e99211583c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.159299 Aug 01 17:00:02.203172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 241/476] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:02 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:00:02.249657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] validate_networks() for [('661b53a4-f07f-4651-8540-371f8dcfac89', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:00:02.630309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:00:02.630914 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:00:02.631224 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:00:02.631640 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:00:02.632114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:00:02.641588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.642047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.642871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.643307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.660019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Getting quotas for project 26251afa3c5e43839015776368defa1d. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:00:02.663991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Getting quotas for user 8c4a2a503fa14203bcf5b98bfbcccbf8 and project 26251afa3c5e43839015776368defa1d. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:00:02.695738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:02.696346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:02.703455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.703904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.704677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:02.705112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:02.721255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:00:02.723579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0322919a-ce98-4b50-bf31-c6380390de0f',volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:00:02.836067 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:02.845144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8646ccd4-3dda-4d77-9052-fd7c1c81ba30 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1714 microversion: 2.1 time: 0.153139 Aug 01 17:00:02.845730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 242/477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:02 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:03.096913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-226b0c2c-a85a-4032-937d-a7aaff0671fd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.971827 Aug 01 17:00:03.097544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 236/478] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:00:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 17:00:03.108866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-56c1a281-63cd-47b5-808e-bcf0aafa170c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:03.109482 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-56c1a281-63cd-47b5-808e-bcf0aafa170c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:03.165800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-56c1a281-63cd-47b5-808e-bcf0aafa170c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:03.172659 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-56c1a281-63cd-47b5-808e-bcf0aafa170c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1089 microversion: 2.1 time: 0.067838 Aug 01 17:00:03.173254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 243/479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:03 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:03.225954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:03.226664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:03.235156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:03.235663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:03.236505 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:03.237150 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:03.371251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:03.379866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:03.381362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:03.382549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e240d9c0-1b97-42aa-a3cb-dcb9b4fca1f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.160908 Aug 01 17:00:03.383115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 237/480] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:03 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:04.194199 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:04.194807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:04.202016 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:04.202508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:04.203266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:04.203692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:04.267201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:04.274586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-659e95d5-9c83-4539-ad30-7931c39fbbb5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1139 microversion: 2.1 time: 0.084198 Aug 01 17:00:04.275144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 244/481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:04 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:04.407370 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:04.407908 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:04.414386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:04.414837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:04.415603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:04.416039 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:04.545085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:04.553166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:04.554874 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:04.556010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-56158e27-b920-4511-8f90-e8cb5adb657d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.153219 Aug 01 17:00:04.556568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 238/482] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:04 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:05.297371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:05.297983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:05.304422 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:05.304875 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:05.305633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:05.306091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:05.367290 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:05.375163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-42d5d82a-7d21-46a8-bf9d-705f7f923eb9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1139 microversion: 2.1 time: 0.082469 Aug 01 17:00:05.375742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 245/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:05 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:05.579292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:05.579807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:05.586328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:05.586782 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:05.587542 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:05.587986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:05.715183 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:05.723600 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:05.725096 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:05.726287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-14f2258a-daa4-40e6-94bb-c23e8bcebc00 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.151090 Aug 01 17:00:05.726831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 239/484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:05 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:06.396278 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:06.396876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:06.403347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:06.403792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:06.404537 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:06.404986 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:06.465582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:06.473377 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6415f708-4d49-444f-b9ab-3d9aa4905fe8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1187 microversion: 2.1 time: 0.080898 Aug 01 17:00:06.476950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 246/485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:06 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1187 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:06.751109 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:06.751721 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:06.760988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:06.761849 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:06.763529 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:06.764120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:06.785519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1890519285", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "networks": [{"uuid": "b2c7e7dc-46c1-419f-8016-b8ba1b14263d"}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:06.848020 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] validate_networks() for [('b2c7e7dc-46c1-419f-8016-b8ba1b14263d', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:00:06.999875 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:07.008820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:07.010581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:07.018871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-81dcf417-e2c5-4026-b026-0980b0a2a5a9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.265671 Aug 01 17:00:07.028414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 240/486] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:06 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:07.495241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:07.499218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:07.502205 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:07.502656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:07.503556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:07.503869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:07.514665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:00:07.517319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:00:07.518447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:00:07.519040 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:00:07.519681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:00:07.542099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:07.542540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:07.543341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:07.543805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:07.560805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Getting quotas for project 025776af0f594ddc9bfd2eedb6eb7602. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:00:07.564826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Getting quotas for user d720864cb0854d549c05e425bffafa86 and project 025776af0f594ddc9bfd2eedb6eb7602. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:00:07.575762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:00:07.578708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:00:07.579284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:07.589335 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-611ca2ab-4d4a-438a-ac48-bc855d3c908a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1205 microversion: 2.1 time: 0.098133 Aug 01 17:00:07.590958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 241/487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:07 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:07.697159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d9c73129-7320-48e7-9793-14f47fbb6e35 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916312 Aug 01 17:00:07.704032 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 247/488] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:00:07.709369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-55b0537c-28c3-407d-985b-00a6eb4f974d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:07.712386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-55b0537c-28c3-407d-985b-00a6eb4f974d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:07.806356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55b0537c-28c3-407d-985b-00a6eb4f974d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:07.815259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-55b0537c-28c3-407d-985b-00a6eb4f974d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1219 microversion: 2.1 time: 0.109579 Aug 01 17:00:07.825869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 242/489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:07 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:08.036486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:08.038394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:08.050357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.056284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.056284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.056284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.214794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:08.223787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:08.225737 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:08.226967 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-464b28fc-dd93-4340-be9b-01132ed15698 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.195520 Aug 01 17:00:08.245815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 248/490] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:08 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:08.611851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:08.612464 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:08.619488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.620046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.620858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.621284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.820843 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:08.829025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ecae3ef8-08c8-4893-b3b1-bae6c1c0b303 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.221690 Aug 01 17:00:08.831587 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 243/491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:08 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:08.836599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:08.837293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:08.843575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.844637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.845826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:08.846333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:08.910141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:08.917670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4c33480e-9219-4373-b3f1-e0d5489bd092 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1223 microversion: 2.1 time: 0.085017 Aug 01 17:00:08.918295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 249/492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:08 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:08.992575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-e2c37ab8-fd87-4eb3-bd75-1778a001cf75 req-76b762ce-e03b-4247-b506-27f14352b8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:09.002921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e2c37ab8-fd87-4eb3-bd75-1778a001cf75 req-76b762ce-e03b-4247-b506-27f14352b8d3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.003361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e2c37ab8-fd87-4eb3-bd75-1778a001cf75 req-76b762ce-e03b-4247-b506-27f14352b8d3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.014884 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-e2c37ab8-fd87-4eb3-bd75-1778a001cf75 req-76b762ce-e03b-4247-b506-27f14352b8d3 service nova] Creating event network-changed:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:00:09.020015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-e2c37ab8-fd87-4eb3-bd75-1778a001cf75 req-76b762ce-e03b-4247-b506-27f14352b8d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031346 Aug 01 17:00:09.020930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 244/493] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:09.251530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:09.252261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:09.258884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.259364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.260318 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.260751 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.392371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:09.400460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:09.401882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:09.403057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6acbd961-a12a-4034-8cc0-7e28c41b05d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.156014 Aug 01 17:00:09.403612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 250/494] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:09 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:09.853477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:09.854285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:09.860985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.861428 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.862517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.862948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.940284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:09.941591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:09.947989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.948548 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:09.957444 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:09.957444 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:10.017452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:10.026248 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6db3754-2f10-49d8-a446-786872299329 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1289 microversion: 2.1 time: 0.090530 Aug 01 17:00:10.027366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 251/495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:09 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:10.046644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:10.057203 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3961c689-dcc7-459b-9dcc-3d28e5b918c4 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.208385 Aug 01 17:00:10.060936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 245/496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:09 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:10.426625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:10.427405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:10.433785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:10.434268 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:10.435164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:10.435592 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:10.623032 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:10.630890 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:10.632384 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:10.633526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-03fe45f6-9aef-420e-b4ab-9276f72e91d1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.211729 Aug 01 17:00:10.634185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 252/497] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:10 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:11.048132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:11.048740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:11.055381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.055837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.056599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.057033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.081024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:11.081638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:11.083632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:11.088396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.088890 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.089664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.090136 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.189438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:11.197686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8eeba8d2-7bc1-48c1-a7e5-b2e25ef04b61 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.153456 Aug 01 17:00:11.198293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 246/498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:11 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:11.225829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:11.233243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3837d138-81e7-41d2-9869-ba73cd7b5807 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.157092 Aug 01 17:00:11.233801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 253/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:11 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:11.657193 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:11.657734 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:11.659731 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:11.664390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.664828 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.665581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:11.666010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:11.800692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:11.808510 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:11.809998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:11.811176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c9a2dafb-77e9-4cbc-949b-2e9ac2305b6d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.158562 Aug 01 17:00:11.811729 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 247/500] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:11 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:12.220244 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:12.220850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:12.228272 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.228703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.229464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.229894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.259714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:12.260324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:12.267852 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.268293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.269054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.269480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.402604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:12.410930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d70b501a-1f44-4bf8-bfb2-26c152b7a1e3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.154919 Aug 01 17:00:12.411641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 248/501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:12 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:12.425368 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:12.432974 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8891f250-d048-48c7-9b71-b6ea06e91187 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.217196 Aug 01 17:00:12.433575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 254/502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:12 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:12.503447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-38e78bcd-db7a-441f-acd6-c9a5c2c7fa9b req-7909eca8-d20d-4440-8983-c8419eca781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c82e71-2349-46ef-b9e2-51e0215c59cc", "tag": "dbbf02e5-8571-48bd-bed3-0b6640399c0f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:12.512864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-38e78bcd-db7a-441f-acd6-c9a5c2c7fa9b req-7909eca8-d20d-4440-8983-c8419eca781b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.513304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-38e78bcd-db7a-441f-acd6-c9a5c2c7fa9b req-7909eca8-d20d-4440-8983-c8419eca781b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.525261 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-38e78bcd-db7a-441f-acd6-c9a5c2c7fa9b req-7909eca8-d20d-4440-8983-c8419eca781b service nova] Creating event network-changed:dbbf02e5-8571-48bd-bed3-0b6640399c0f for instance 70c82e71-2349-46ef-b9e2-51e0215c59cc on hv-cinder-84989 Aug 01 17:00:12.530745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-38e78bcd-db7a-441f-acd6-c9a5c2c7fa9b req-7909eca8-d20d-4440-8983-c8419eca781b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030583 Aug 01 17:00:12.532017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 249/503] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:12.834754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:12.835362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:12.841216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.841666 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:12.842453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:12.842889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:13.057751 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:13.066689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:13.069036 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:13.070247 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-07df4126-490a-4bb6-b281-62aef06d6990 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.239333 Aug 01 17:00:13.070813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 255/504] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:12 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:13.432381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:13.432994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:13.434948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:13.440526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:13.441096 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:13.441860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:13.442323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:13.453433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:13.454086 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:13.460970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:13.461446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:13.462238 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:13.462677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:13.579746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:13.587555 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ee9c8618-30d7-4e4a-a115-c27e22b84e87 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.159452 Aug 01 17:00:13.588131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 250/505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:13 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:13.593992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:13.601541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fcf06636-0e67-4945-858d-89f8c07eace4 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.152679 Aug 01 17:00:13.602122 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 256/506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:13 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:14.093491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:14.094024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:14.100158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.100609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.101375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.101815 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.231180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:14.239668 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:14.241475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:14.242678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e8ac3ae5-7b5e-4421-9af7-677d81712553 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.153189 Aug 01 17:00:14.243239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 251/507] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:14 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:14.607692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:14.608339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:14.615867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.616567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.617411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.617856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.622532 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:14.623255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:14.629618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.630083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.630866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:14.631301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:14.649438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:14.754159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:14.761653 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e2422bb9-2182-44b6-9c57-a73ac23c96d2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.157815 Aug 01 17:00:14.762335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 257/508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:14 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:14.762758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:14.770833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-703d7c8d-e1bb-46c4-9f30-b1b107ba4059 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.152103 Aug 01 17:00:14.771473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 252/509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:14 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:15.266626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:15.267240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:15.273295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.273745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.274542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.274983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.292223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:15.402387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:15.410285 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:15.411792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:15.412933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-71d7b6a1-4de9-43c5-9c2b-b6ddc8d7fbda tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.150852 Aug 01 17:00:15.413489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 258/510] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:15 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:15.783483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:15.784095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:15.791193 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.791580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:15.791995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.792186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:15.792377 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.792807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.799058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.799539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.800293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:15.800729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:15.934173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:15.934529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:15.939632 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5dc855d0-5d3a-4f2d-8d4e-0574301be03a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.160498 Aug 01 17:00:15.940217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 253/511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:15 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:15.941673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e2c88aec-7e0e-4f0e-bdf3-febaa05b1d6f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.153822 Aug 01 17:00:15.942262 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 259/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:15 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:16.435985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:16.436599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:16.442794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.443245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:16.444013 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.444452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:16.573189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:16.581829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:16.583452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:16.585993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-275a64d0-14c6-41c7-93a0-88af34e69ebc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.152669 Aug 01 17:00:16.585993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 254/513] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:16 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:16.960667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:16.961326 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:16.962919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:16.963662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:16.967856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.968306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:16.969079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.969513 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:16.970733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.971194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:16.971966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:16.972407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:17.105361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:17.105708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:17.113670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cc5ec28f-ac26-4cc8-af48-df5fb2cfa544 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.156823 Aug 01 17:00:17.113844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d6361caa-fb4f-46c4-a902-7f40cb2f5498 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.154752 Aug 01 17:00:17.114470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 260/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:16 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:17.114589 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 255/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:16 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:17.608707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:17.610189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:17.611902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:17.612673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=8 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:17.617584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:17.620849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:17.620849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:17.620849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:17.751548 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:17.759387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:17.760893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:17.762075 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-829adc04-70ce-48ce-8d1a-e7a92cdf28e4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.157318 Aug 01 17:00:17.762634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 261/516] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:17 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:18.135790 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:18.136416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:18.140054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:18.140769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:18.143205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.143687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.144519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.144960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.145716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=8 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:18.148083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.148530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.149303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.149735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.295897 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:18.296400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:18.304214 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d19e0629-7324-4391-8bc9-1e55bd8d11d5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.167888 Aug 01 17:00:18.305121 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 256/517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:18 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:18.308693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0b8fd8f6-3af6-4234-b181-021dc63121ea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.173288 Aug 01 17:00:18.316211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 262/518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:18 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:18.785176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:18.785825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:18.791989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.792438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.793229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:18.793663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:18.923745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:18.931627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:18.933139 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:18.934333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-25156b1b-75e7-4225-ad65-9bf206798c2d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.153536 Aug 01 17:00:18.935100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 257/519] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:18 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:19.327067 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:19.327597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:19.329104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:19.329870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:19.334242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.334687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:19.335451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.335883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:19.336394 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.336845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:19.337615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.338078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:19.465765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:19.473270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:19.473692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ee90a6a2-b412-47c8-90e1-029a6c07c43d tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.150536 Aug 01 17:00:19.474295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 263/520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:19 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:19.480996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4160a0fd-b164-46b5-a4bc-cfd08b76d48d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.155711 Aug 01 17:00:19.481558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 258/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:19 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:19.960206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:19.967228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:19.967228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.967429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:19.968110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:19.969186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:20.100017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:20.107928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:20.110219 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:20.111372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1e0ba921-7506-4378-908f-99ae719b3859 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.155230 Aug 01 17:00:20.111941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 264/522] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:19 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:20.494656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:20.495412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:20.502156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:20.502612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:20.502700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:20.502818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:20.503423 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:20.503870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:20.509387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:20.509856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:20.510648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:20.511085 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:20.543271 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:00:20.543482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc (ip 10.222.0.20) !!! Aug 01 17:00:20.645423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:20.648049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:20.653537 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-aa510ca1-fe36-4a98-a8ca-4ce05a7f38a0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.155246 Aug 01 17:00:20.654143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 265/523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:20 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:20.661413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-24605f53-a7ac-4e6e-acca-426ec0987819 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.165264 Aug 01 17:00:20.661413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 259/524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:20 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:21.136079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:21.136774 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:21.143684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.144171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.144941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.145374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.277867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:21.286306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:21.287828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:21.289036 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dceff19d-40d0-465a-87a8-d64b4bfdcd94 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.157846 Aug 01 17:00:21.289607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 266/525] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:21 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:21.389282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-acd667af-4f4c-4621-b945-93c2dff15198 req-7d7dc42f-5480-451e-b626-94150a7ec8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c82e71-2349-46ef-b9e2-51e0215c59cc", "name": "network-vif-plugged", "status": "completed", "tag": "dbbf02e5-8571-48bd-bed3-0b6640399c0f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:21.399583 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-acd667af-4f4c-4621-b945-93c2dff15198 req-7d7dc42f-5480-451e-b626-94150a7ec8cc service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.400028 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-acd667af-4f4c-4621-b945-93c2dff15198 req-7d7dc42f-5480-451e-b626-94150a7ec8cc service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.411975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-acd667af-4f4c-4621-b945-93c2dff15198 req-7d7dc42f-5480-451e-b626-94150a7ec8cc service nova] Creating event network-vif-plugged:dbbf02e5-8571-48bd-bed3-0b6640399c0f for instance 70c82e71-2349-46ef-b9e2-51e0215c59cc on hv-cinder-84989 Aug 01 17:00:21.417330 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-acd667af-4f4c-4621-b945-93c2dff15198 req-7d7dc42f-5480-451e-b626-94150a7ec8cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031845 Aug 01 17:00:21.418383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 260/526] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:21.674845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:21.675547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:21.677417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:21.678155 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:21.682602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.683114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.684023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.684332 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.684837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.684921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.685538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:21.685978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:21.824990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:21.833136 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-73debd38-c2ab-4199-a19f-a9f206005aed tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.160176 Aug 01 17:00:21.833825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 261/527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:21 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:21.878343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:21.885983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e5159a75-116d-4b27-bf8c-3e12841b511c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.215065 Aug 01 17:00:21.886579 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 267/528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:21 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:22.312050 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:22.313282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:22.319305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.319751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:22.320508 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.320966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:22.449996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:22.458052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:22.459623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:22.460805 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-22e48722-d5da-4a42-ab1d-c599d47a15db tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.152754 Aug 01 17:00:22.461369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 262/529] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:22 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:22.854439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:22.855124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:22.862724 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.863175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:22.863936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.864371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:22.907794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:22.908791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:22.914470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.914916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:22.915673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:22.916097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:23.002338 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:23.009764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d59d1c43-afa1-44d2-996f-b82d107794a7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.159098 Aug 01 17:00:23.010357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 268/530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:22 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:23.052057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:23.059942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3a818271-588f-40a5-9bb2-4fac142c1050 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.156826 Aug 01 17:00:23.060514 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 263/531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:22 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:23.483840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:23.485077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:23.491453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:23.491908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:23.492674 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:23.493110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:23.626512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:23.634854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:23.636356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:23.641017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2921ebb6-8836-48da-b372-69dcbc8a87b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.157629 Aug 01 17:00:23.641017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 269/532] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:23 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:23.763624 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1bf57210-ffc1-48e8-b6f4-b17a0ba36bc1 req-e430372c-1b9a-4402-a036-1b43f3dd092b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "name": "network-vif-plugged", "status": "completed", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:23.774165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1bf57210-ffc1-48e8-b6f4-b17a0ba36bc1 req-e430372c-1b9a-4402-a036-1b43f3dd092b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:23.774614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1bf57210-ffc1-48e8-b6f4-b17a0ba36bc1 req-e430372c-1b9a-4402-a036-1b43f3dd092b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:23.786371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1bf57210-ffc1-48e8-b6f4-b17a0ba36bc1 req-e430372c-1b9a-4402-a036-1b43f3dd092b service nova] Creating event network-vif-plugged:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:00:23.791108 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1bf57210-ffc1-48e8-b6f4-b17a0ba36bc1 req-e430372c-1b9a-4402-a036-1b43f3dd092b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Aug 01 17:00:23.795811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 264/533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:24.030520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:24.032490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:24.038738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.039180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.040119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.040708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.081519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:24.082496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:24.089353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.089925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.090942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.091365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.214835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:24.223138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a42a803f-f596-451f-ba7d-57eee783771f tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1319 microversion: 2.1 time: 0.196335 Aug 01 17:00:24.223702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 270/534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:24 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:24.230472 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:24.239175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7726fc31-6086-4355-b0c4-e97aff6c426d tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.161875 Aug 01 17:00:24.239902 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 265/535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:24 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:24.660973 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:24.661580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:24.667547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.667994 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.668743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:24.669175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:24.794769 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:24.803593 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:24.805145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:24.806335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-36d16b11-f7d3-4b33-94c3-670a75df3e5d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.149236 Aug 01 17:00:24.806906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 271/536] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:24 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:25.245199 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:25.245739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:25.252565 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.253012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.253770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.254987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.260616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:25.261288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:25.268376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.268828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.269598 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.270061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.388990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:25.396718 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cbea86be-1784-40ee-a5bc-aaa383c42d70 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1509 microversion: 2.1 time: 0.155625 Aug 01 17:00:25.397293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 266/537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:25 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:25.405232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:25.413062 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-11047eff-8b80-432f-a50e-64d539ff662c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.156227 Aug 01 17:00:25.413638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 272/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:25 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:25.416994 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a32198e-d146-4950-81cb-42240ddad293", "device": "/dev/sdb"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:25.419808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:25.426615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.427055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.427809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.428236 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.806587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-c72f1f5e-d226-4d6d-9497-d4738ae297c0 req-b4cdb569-fac9-42ce-92bd-5448eb97d0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "name": "network-vif-plugged", "status": "completed", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:25.815960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c72f1f5e-d226-4d6d-9497-d4738ae297c0 req-b4cdb569-fac9-42ce-92bd-5448eb97d0e3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.816405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c72f1f5e-d226-4d6d-9497-d4738ae297c0 req-b4cdb569-fac9-42ce-92bd-5448eb97d0e3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.826877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-c72f1f5e-d226-4d6d-9497-d4738ae297c0 req-b4cdb569-fac9-42ce-92bd-5448eb97d0e3 service nova] Creating event network-vif-plugged:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 17:00:25.831861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-c72f1f5e-d226-4d6d-9497-d4738ae297c0 req-b4cdb569-fac9-42ce-92bd-5448eb97d0e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028872 Aug 01 17:00:25.832437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 273/539] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:00:25.837248 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:25.837941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:25.844328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.844775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.845535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:25.845973 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:25.975134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:25.983000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:25.984715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:25.985883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-457b889a-b714-467f-87f2-dbd58efad18f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.152401 Aug 01 17:00:25.986470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 274/540] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:25 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:26.434337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:26.434948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:26.441708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:26.442199 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:26.443003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:26.443440 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:26.577837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:26.581425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:26.585983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b168f0fe-5785-493c-8201-a2bd40dacb45 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1260 microversion: 2.1 time: 0.155529 Aug 01 17:00:26.586633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 275/541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:26 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:00:26.818758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-298b3357-e54f-4c66-bbf2-6fd910733feb tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "POST /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.405348 Aug 01 17:00:26.819373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 267/542] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:00:25 2022] POST /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc/os-volume_attachments => generated 194 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:00:27.008884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:27.009409 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:27.016596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.017045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.017815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.018283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.148125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:27.155931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:27.157434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:27.158618 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f367ab45-f8d0-4eaa-9e62-cba202b9a304 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.153826 Aug 01 17:00:27.159167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 276/543] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:27 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:27.607857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:27.608553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:27.615705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.616420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.617163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.617596 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.752626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:27.760409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-945e1fac-0a86-4cd3-b236-ab51ed60f461 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1444 microversion: 2.1 time: 0.157358 Aug 01 17:00:27.761021 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 268/544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:27 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:27.780397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:27.781243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:27.787772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.788215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.788989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:27.789406 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:27.921332 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:27.929734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d258b241-21dc-4ddc-b701-7e7499a681a3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1444 microversion: 2.1 time: 0.153177 Aug 01 17:00:27.930350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 277/545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:27 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:28.180894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:28.181513 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:28.188766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:28.189215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:28.189985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:28.190442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:28.194558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:28.413625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:28.422167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:28.423781 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:28.425105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e1bc59e8-1b4b-4943-8a43-2b799b0c774c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.248122 Aug 01 17:00:28.438218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 269/546] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:28 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:29.448823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:29.449426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:29.456102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:29.456560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:29.457332 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:29.457770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:29.593071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:29.601666 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:29.603284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:29.604508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-601d6a12-53ec-4bd1-9951-5dd981fe2ad3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.159699 Aug 01 17:00:29.605144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 278/547] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:29 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:30.065046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-dea679da-2f38-4bb6-b4d6-1117f606b96b req-49b1e7fd-5e84-4900-826c-e59b8258e900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:30.075414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-dea679da-2f38-4bb6-b4d6-1117f606b96b req-49b1e7fd-5e84-4900-826c-e59b8258e900 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:30.075862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-dea679da-2f38-4bb6-b4d6-1117f606b96b req-49b1e7fd-5e84-4900-826c-e59b8258e900 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:30.086667 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-dea679da-2f38-4bb6-b4d6-1117f606b96b req-49b1e7fd-5e84-4900-826c-e59b8258e900 service nova] Creating event network-changed:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:00:30.091735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-dea679da-2f38-4bb6-b4d6-1117f606b96b req-49b1e7fd-5e84-4900-826c-e59b8258e900 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099428 Aug 01 17:00:30.092354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 270/548] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:30.629236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:30.629889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:30.636546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:30.637063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:30.637977 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:30.638507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:30.879348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:30.879892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:30.880982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:30.882758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-eee7524b-0126-4611-a19d-e064782e1b58 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1742 microversion: 2.20 time: 0.257173 Aug 01 17:00:30.883540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 279/549] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:30 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1742 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:31.912518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:31.913309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:31.920077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:31.920541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:31.921313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:31.922390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:32.094944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:32.103661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:32.105262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:32.106890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1ae1222d-7a05-488a-b1c9-a7182b78ad9f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.201401 Aug 01 17:00:32.107807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 271/550] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:31 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:00:33.131656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:33.132932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:33.140192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:33.140650 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:33.141429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:33.141866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:33.318868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:33.327349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:33.329865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:33.331372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7f3e79b6-037a-4dc8-909f-b2b76ac2aa32 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.203683 Aug 01 17:00:33.332514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 280/551] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:33 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:34.355493 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:34.356091 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:34.363042 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:34.364713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:34.366543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:34.366985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:34.554500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:34.563847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:34.565351 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:34.566594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca34701d-33fe-4eca-8fa1-09ca9951d5cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.215831 Aug 01 17:00:34.567161 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 272/552] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:34 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:35.590235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:35.614175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:35.614175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:35.614175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:35.614175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:35.614589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:35.741516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:35.757616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:35.759147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:35.764587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ea3e58c4-17a6-49e9-9db8-f21aeb71da39 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.178365 Aug 01 17:00:35.765147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 281/553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:35 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:36.788467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:36.789190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:36.796489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:36.797566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:36.798438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:36.799048 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:36.952970 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:36.964273 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:36.971738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:36.971738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-43d653c9-1052-4f3f-b484-86332b203026 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.184204 Aug 01 17:00:36.986220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 273/554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:36 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:37.995876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:37.996506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:38.003555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:38.004097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:38.004846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:38.005286 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:38.154569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:38.163736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:38.165563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:38.166760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-60b1e7f1-4661-43f5-9271-d558b2f0e598 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.175428 Aug 01 17:00:38.167595 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 282/555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:37 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:39.191576 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:39.192429 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:39.199292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:39.201421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:39.202266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:39.203788 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:39.339916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:39.348109 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:39.349605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:39.350833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5cb93c9a-6336-4d1d-ade3-83736b7a7eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.164044 Aug 01 17:00:39.351395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 274/556] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:39 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:40.373713 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:40.374350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:40.382231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:40.382685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:40.383746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:40.384240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:40.527906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:40.537614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:40.539264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:40.540560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-71e81ca1-a075-48fa-acfd-b35cbdf6550d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.171160 Aug 01 17:00:40.543431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 283/557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:40 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:41.575591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:41.576196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:41.583104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:41.583799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:41.584797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:41.585233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:41.982149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:41.991674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:41.993170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:41.994610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2adf798-7229-4d2c-bdcb-2813bc414f17 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.422651 Aug 01 17:00:42.010571 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 275/558] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:41 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:43.019648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:43.020274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:43.022615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=62 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:43.027600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:43.028055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:43.028821 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:43.029261 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:43.169408 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:43.178464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:43.179975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:43.181141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0f20763d-1583-4ba6-b256-45b46d53e77c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.166559 Aug 01 17:00:43.181705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 284/559] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:43 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:44.205668 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:44.206321 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:44.208785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=58 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:44.213701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:44.214264 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:44.215078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:44.215522 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:44.347762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:44.356020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:44.361862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:44.361862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7b644cf0-e47f-46e3-8473-da6617b15c76 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.158293 Aug 01 17:00:44.361862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 276/560] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:44 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:45.381366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:45.381966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:45.388629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:45.389069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:45.389815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:45.390274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:45.518769 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:45.526710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:45.528216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:45.529374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e3a5f5b1-0861-4b44-8770-c11baceb43d6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.151848 Aug 01 17:00:45.529937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 285/561] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:45 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:46.552767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:46.553362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:46.559849 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:46.560299 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:46.561061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:46.561495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:46.692148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:46.699980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:46.701482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:46.702746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3e534cef-96ef-4490-933b-e524741ff1cf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.153874 Aug 01 17:00:46.704020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 277/562] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:46 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:47.726514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:47.727118 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:47.733566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:47.734021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:47.735007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:47.735443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:47.861736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:47.869791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:47.871345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:47.872499 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5e7a0f11-73b6-4a7c-b1a7-c98f3a3035a8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.149972 Aug 01 17:00:47.873057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 286/563] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:47 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:48.895715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:48.938345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:48.938345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:48.938345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:48.938345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:48.939328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:49.033870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:49.041953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:49.043484 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:49.044674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d07bd458-5849-4997-828f-5c00d7311e21 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.152812 Aug 01 17:00:49.045241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 278/564] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:48 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:50.068176 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:50.068796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:50.075372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:50.075824 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:50.076618 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:50.077056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:50.210275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:50.218208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:50.219706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:50.220868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ec8b4e1c-9dd0-48d1-9534-57324ea341b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1737 microversion: 2.20 time: 0.156531 Aug 01 17:00:50.221424 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 287/565] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:50 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:00:51.243850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:51.244495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:51.252246 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:51.256231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:51.256231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:51.256231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:51.388463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:51.397499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:51.399142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:51.400305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7385fc7f-07d9-46c3-97ba-2252106eee4e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1719 microversion: 2.20 time: 0.160763 Aug 01 17:00:51.400907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 279/566] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:51 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:52.423519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:52.424167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:52.431873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:52.431873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:52.432112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:52.432519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:52.561347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:52.569555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:52.571069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:52.572231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3c285c77-dd51-4a6d-ba35-2f2f8fff2bbd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1719 microversion: 2.20 time: 0.152875 Aug 01 17:00:52.572785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 288/567] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:52 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:53.460037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:53.460567 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:53.467294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.467750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.469094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.469740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.552733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lazy-loading 'services' on Instance uuid 70c82e71-2349-46ef-b9e2-51e0215c59cc {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:00:53.595968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:53.596689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:53.602975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.603430 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.604292 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.604643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.743438 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:53.753226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:53.754915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:53.756098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7bc3741a-33db-4c5a-b819-69d6add6f3a4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1722 microversion: 2.20 time: 0.164516 Aug 01 17:00:53.756664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 289/568] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:53 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:00:53.774148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b3ef17ee-a670-4dc9-a27b-257811996f63 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc/os-volume_attachments/0a32198e-d146-4950-81cb-42240ddad293" status: 202 len: 0 microversion: 2.1 time: 0.318873 Aug 01 17:00:53.777024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 280/569] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:00:53 2022] DELETE /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc/os-volume_attachments/0a32198e-d146-4950-81cb-42240ddad293 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:00:53.784871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "478b4f06-11a7-40a7-b645-300e0ce3ffd4"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:53.788057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:53.794932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.795623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.797263 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.798213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.831106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-9af41e16-e1b1-4fb9-a666-11cdb962514a req-79b32c1f-6d68-4efb-b31c-2d8e9c1254a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:53.852468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9af41e16-e1b1-4fb9-a666-11cdb962514a req-79b32c1f-6d68-4efb-b31c-2d8e9c1254a3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:53.858223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9af41e16-e1b1-4fb9-a666-11cdb962514a req-79b32c1f-6d68-4efb-b31c-2d8e9c1254a3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:53.872678 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-9af41e16-e1b1-4fb9-a666-11cdb962514a req-79b32c1f-6d68-4efb-b31c-2d8e9c1254a3 service nova] Creating event network-vif-unplugged:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 17:00:53.878604 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-9af41e16-e1b1-4fb9-a666-11cdb962514a req-79b32c1f-6d68-4efb-b31c-2d8e9c1254a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120674 Aug 01 17:00:53.879285 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 290/570] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:00:54.779409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-50bef644-096a-45e7-9cc7-b10cf85532bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.999488 Aug 01 17:00:54.780036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 281/571] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 1 17:00:53 2022] POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments => generated 188 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 17:00:54.951448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:54.952159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:54.958820 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:54.960266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:54.960266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:54.960485 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:55.004527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124835) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 17:00:55.274698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-136266d0-867b-4418-b09c-d41b1301ff59 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/action" status: 202 len: 0 microversion: 2.20 time: 0.328321 Aug 01 17:00:55.275503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 291/572] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 1 17:00:54 2022] POST /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:00:55.284846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:55.286234 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:55.292444 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:55.292921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:55.293700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:55.294162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:55.429832 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:55.438693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:55.440207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:55.441385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cc92d2e8-2fd7-4b95-acea-55620119ae8f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1748 microversion: 2.20 time: 0.161625 Aug 01 17:00:55.442140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 282/573] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:55 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:55.965142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:55.966052 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:55.972706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:55.973161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:55.973932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:55.974395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:55.978652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:56.000257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:00:56.300739 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bf021401-38b4-4a4e-ac38-f50387d21ed5 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 204 len: 0 microversion: 2.1 time: 0.339709 Aug 01 17:00:56.301370 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 292/574] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:00:55 2022] DELETE /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:00:56.309658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:56.310409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:56.317550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:56.318131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:56.318971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:56.319476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:56.323614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:00:56.455979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:56.464523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ffe1e4e4-2a0a-4aed-8b82-502447b0a535 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1515 microversion: 2.1 time: 0.158718 Aug 01 17:00:56.471475 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:56.471622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 283/575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:56 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:56.471715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:56.472789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:56.473242 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:56.474065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:56.474482 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:56.605511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:56.614711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:56.617310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:56.617616 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6b113b43-942b-4fb8-b125-5048317976f4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1748 microversion: 2.20 time: 0.156801 Aug 01 17:00:56.618202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 293/576] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:56 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:00:57.487783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:57.488314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:57.495838 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:57.496281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:57.497039 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:57.497806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:57.624391 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:57.632041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d7b761c-4051-45a9-999d-0887aaebd206 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1515 microversion: 2.1 time: 0.148609 Aug 01 17:00:57.632612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 284/577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:57 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:57.649579 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:57.650229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:57.657170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:57.657614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:57.658426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:57.658855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:57.799078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:57.807398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:57.808897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:57.810065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-416b6629-1cb3-4c55-8beb-a8ced5ff2351 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1748 microversion: 2.20 time: 0.173393 Aug 01 17:00:57.810636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 294/578] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:57 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:58.653106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:58.653724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:58.661117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:58.661572 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:58.662364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:58.662805 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:58.796585 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:58.804696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4bc40517-0cc3-4c00-b2d5-9b3965b29fd7 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1515 microversion: 2.1 time: 0.155401 Aug 01 17:00:58.805271 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 285/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:58 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:00:58.834013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:58.834741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:58.841080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:58.841533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:58.846503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:58.846503 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:59.067641 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:59.076716 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:59.078952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:59.080211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9f670960-0949-4c6c-9e6a-ddbf18bf5c7b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1750 microversion: 2.20 time: 0.250174 Aug 01 17:00:59.080721 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 295/580] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:00:58 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1750 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:00:59.125989 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-2f2a6ed2-5e00-41ce-9449-fa91383d5f5e req-fbe442f1-67bd-458c-88ae-e79c08a85cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c82e71-2349-46ef-b9e2-51e0215c59cc", "name": "network-vif-deleted", "tag": "dbbf02e5-8571-48bd-bed3-0b6640399c0f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:00:59.135336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2f2a6ed2-5e00-41ce-9449-fa91383d5f5e req-fbe442f1-67bd-458c-88ae-e79c08a85cb1 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:59.135782 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2f2a6ed2-5e00-41ce-9449-fa91383d5f5e req-fbe442f1-67bd-458c-88ae-e79c08a85cb1 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:59.146901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-2f2a6ed2-5e00-41ce-9449-fa91383d5f5e req-fbe442f1-67bd-458c-88ae-e79c08a85cb1 service nova] Creating event network-vif-deleted:dbbf02e5-8571-48bd-bed3-0b6640399c0f for instance 70c82e71-2349-46ef-b9e2-51e0215c59cc on hv-cinder-84989 Aug 01 17:00:59.151710 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-2f2a6ed2-5e00-41ce-9449-fa91383d5f5e req-fbe442f1-67bd-458c-88ae-e79c08a85cb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089120 Aug 01 17:00:59.152340 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 286/581] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:00:59.825291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:00:59.825894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:00:59.833001 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:59.833455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:59.834258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:59.834791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:59.867196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:00:59.867640 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:00:59.868087 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lazy-loading 'fault' on Instance uuid 70c82e71-2349-46ef-b9e2-51e0215c59cc {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:00:59.910344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd720864cb0854d549c05e425bffafa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025776af0f594ddc9bfd2eedb6eb7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:00:59.918882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bf2e8a27-023f-4d7f-b2df-948f351f6eea tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 200 len: 1309 microversion: 2.1 time: 0.097340 Aug 01 17:00:59.919712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 296/582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:00:59 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:00.105237 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:00.105971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:00.113478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:00.113903 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:00.114702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:00.115131 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:00.249517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:00.258002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:00.259516 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:00.260675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34f32c49-3ef4-4c1b-8116-e75d82b61406 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.160414 Aug 01 17:01:00.261226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 287/583] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:00 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:00.941346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:00.941962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] [instance: 70c82e71-2349-46ef-b9e2-51e0215c59cc] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:00.948664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:00.949114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:00.949885 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:00.950347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:00.963724 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] HTTP exception thrown: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Request method failure captured: Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc HTTP/1.1 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AYl0uFffCZ2BnA8n4SONic1i2TanDR_mhSqiYZ11XQ4w--u54xqCVXKEJO7iDwRaYQM3-fd0kgtzXfF14ZxsXu30el-JpAvdW9K60R4VqeIc8AEbt0xdIz7DpY3YT343-ZZH1yKpBgyJ1-SrNhXjlLaOlRgSAB0zkNo6rY-JqPJmDY Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 025776af0f594ddc9bfd2eedb6eb7602 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:01:00.965413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/025776af0f594ddc9bfd2eedb6eb7602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 025776af0f594ddc9bfd2eedb6eb7602 Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-747928240 Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesSnapshotTestJSON-747928240-project Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: d720864cb0854d549c05e425bffafa86 Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesSnapshotTestJSON-747928240-project Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. Aug 01 17:01:00.971049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '70c82e71-2349-46ef-b9e2-51e0215c59cc'} Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:01:00.971971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. Aug 01 17:01:00.973382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:01:00.975084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] Returning 404 to user: Instance 70c82e71-2349-46ef-b9e2-51e0215c59cc could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:01:00.975084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fb937130-598f-4eb7-b31d-08bd4e05c9a3 tempest-VolumesSnapshotTestJSON-747928240 tempest-VolumesSnapshotTestJSON-747928240-project] 10.222.0.20 "GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc" status: 404 len: 111 microversion: 2.1 time: 0.029586 Aug 01 17:01:00.975084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 297/584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:00 2022] GET /compute/v2.1/servers/70c82e71-2349-46ef-b9e2-51e0215c59cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:01:01.283150 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:01.286171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:01.291097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:01.291570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:01.292348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:01.292841 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:01.452732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:01.453579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:01.456177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:01.457347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2f2530de-d16e-4965-8812-f24a82ce0f89 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.178373 Aug 01 17:01:01.457915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 288/585] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:01 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:02.480024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:02.480628 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:02.487684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:02.488142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:02.488884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:02.489312 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:02.653412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:02.663502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:02.665015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:02.666233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-50a81b16-9f46-4e25-952c-b4124ac8677d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.190018 Aug 01 17:01:02.673849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 298/586] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:02 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:03.695970 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:03.696934 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:03.704445 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:03.705052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:03.705974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:03.706517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:03.843224 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:03.852602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:03.854175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:03.855350 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b2a3aa6f-3c6e-4344-8888-00b2c09c34b2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.163505 Aug 01 17:01:03.855922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 289/587] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:03 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:04.879271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:04.879883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:04.886526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:04.886982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:04.887759 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:04.888200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:05.023131 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:05.032669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:05.035129 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:05.035415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8579d409-f027-41ad-9339-1387664aca88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.160073 Aug 01 17:01:05.035966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 299/588] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:04 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:06.058976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:06.059579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:06.066915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:06.067367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:06.068129 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:06.068566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:06.196010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:06.204764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:06.206288 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:06.207447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-430669b9-9fd6-43ce-afff-5551bc9ad75c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.152575 Aug 01 17:01:06.208005 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 290/589] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:06 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:07.231700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:07.232310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:07.239479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:07.239939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:07.240714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:07.241409 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:07.388664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:07.397999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:07.399552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:07.400789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-88e9b519-c911-430b-b9f1-e65b57944d07 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.173141 Aug 01 17:01:07.401340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 300/590] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:07 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:01:08.423863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:08.424435 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:08.430993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:08.431443 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:08.432215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:08.432647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:08.568268 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:08.576669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:08.578474 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:08.579643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04faf807-28f7-4d43-86f2-a91842295e19 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.159860 Aug 01 17:01:08.580213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 291/591] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:08 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:09.603519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:09.604133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:09.611354 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:09.611804 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:09.612572 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:09.613219 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:09.745407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:09.754865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:09.756374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:09.757592 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6485d37b-f32e-4a33-b61b-4350d72f347a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.158098 Aug 01 17:01:09.758114 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 301/592] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:09 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:01:10.780708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:10.782126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:10.788707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:10.789100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:10.789865 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:10.790323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:10.917410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:10.926413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:10.927898 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:10.929070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-aad8f127-4721-40aa-af1f-d1624cfa5cd3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.152337 Aug 01 17:01:10.929626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 292/593] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:10 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:11.952951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:11.953684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:11.960597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:11.961039 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:11.961805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:11.962262 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:12.107635 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:12.116740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:12.118381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:12.119532 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0fed8be9-1bbd-4e03-aa85-871a43f1c202 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.170997 Aug 01 17:01:12.120089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 302/594] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:11 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:13.144759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:13.145352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:13.151925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:13.152375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:13.153142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:13.153581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:13.297971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:13.306321 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:13.307928 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:13.309136 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b7df0033-e643-4e6d-9bdc-0ef36eb26c29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.168963 Aug 01 17:01:13.309995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 293/595] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:13 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:14.333055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:14.333619 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:14.340102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:14.340551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:14.341316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:14.341760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:14.484269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:14.493557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:14.495105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:14.497097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-569b4d98-00a4-47e5-a92c-eb6cc28f6873 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.168055 Aug 01 17:01:14.497805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 303/596] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:14 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:15.521174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:15.525471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:15.525471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=36 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:15.529419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:15.529871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:15.530776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:15.531217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:15.666064 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:15.675166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:15.676698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:15.677863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-193fd2f3-aeb2-4b3c-9d62-59ee3070fa2c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.160970 Aug 01 17:01:15.678456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 294/597] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:15 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:16.701509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:16.702173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:16.705249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:16.713251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:16.713251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:16.713251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:16.713251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:16.848372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:16.857239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:16.859145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:16.860353 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4aaa4ed4-ed1d-4344-8ade-c377dfd2bc53 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.162776 Aug 01 17:01:16.860991 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 304/598] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:16 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:17.884707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:17.885341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:17.891820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:17.892267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:17.893030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:17.893465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:18.027158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:18.036098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:18.037598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:18.038985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e6887a4b-e4fa-471e-a44f-cacd984aa002 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.158026 Aug 01 17:01:18.039360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 295/599] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:17 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:19.063392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:19.064684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:19.071170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:19.071614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:19.075928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:19.075928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:19.204716 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:19.213367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:19.214905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:19.216168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7c4476c1-3dc7-4dac-8ccd-06205a5ce84e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.157382 Aug 01 17:01:19.216731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 305/600] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:19 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:20.239990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:20.240601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:20.246836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:20.247287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:20.248051 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:20.248492 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:20.377431 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:20.385916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:20.387453 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:20.388625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-47e598c8-de75-4a81-b04a-e24c6abf7480 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.153311 Aug 01 17:01:20.389193 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 296/601] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:20 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:21.412385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:21.413018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:21.419955 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:21.420395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:21.421149 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:21.421581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:21.565229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:21.573520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:21.575056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:21.576206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-55bc7737-e6d6-466b-b501-27a14c48af1a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.168396 Aug 01 17:01:21.576763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 306/602] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:21 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:22.599292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:22.599909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:22.606195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:22.606646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:22.607409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:22.607848 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:22.734742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:22.743537 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:22.745027 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:22.746213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-52247a5c-42a6-43fa-916f-be8a2f0f3dcf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.150743 Aug 01 17:01:22.746778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 297/603] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:22 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:23.770116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:23.770727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:23.777266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:23.777708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:23.778490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:23.778925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:23.798559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:23.913414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:23.921794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:23.923352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:23.925427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c971a081-c67e-4c10-9ad4-1a1a67174eeb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.159573 Aug 01 17:01:23.925981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 307/604] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:23 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:24.949891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:24.950543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:24.957317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:24.960192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:24.960192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:24.960192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:25.093940 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:25.103146 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:25.104864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:25.105894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8d11cf58-6d08-4b0c-b1c5-325b080f6121 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.160963 Aug 01 17:01:25.106498 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 298/605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:24 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:26.130446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:26.131061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:26.137564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:26.138015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:26.138805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:26.139240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:26.266219 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:26.274591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:26.276098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:26.277274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e7526e43-09b3-447e-8833-1256d2dcef67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.151330 Aug 01 17:01:26.277839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 308/606] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:26 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:27.302166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:27.302791 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:27.310480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:27.311058 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:27.312661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:27.313097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:27.446018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:27.454386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:27.455880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:27.457041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a25db2fa-358b-4ff1-bf4c-eb0e6d701516 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.159752 Aug 01 17:01:27.457602 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 299/607] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:27 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:28.480019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:28.480633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:28.487845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:28.488291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:28.489081 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:28.489512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:28.622464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:28.631841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:28.633342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:28.634577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e153c291-d4ca-4e8c-8ad8-65a8bbfb034d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.158335 Aug 01 17:01:28.635201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 309/608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:28 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:29.657500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:29.658142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:29.665456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:29.665987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:29.666861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:29.667427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:29.671601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:29.809311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:29.818014 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:29.819545 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:29.820719 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bcce4f5c-373f-4791-b282-209eaa83ecae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.166993 Aug 01 17:01:29.821285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 300/609] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:29 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:30.844947 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:30.845561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:30.852632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:30.853082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:30.853847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:30.854311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:30.987363 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:30.996166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:31.004446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:31.004446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c709cf51-ccb2-44ef-91fe-14a15462b283 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.159198 Aug 01 17:01:31.004446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 310/610] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:30 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:32.023995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:32.024609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:32.031166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:32.031617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:32.032387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:32.032833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:32.162975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:32.171638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:32.173175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:32.175249 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2821dea6-7e11-4127-963b-c9771e1e1474 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.154853 Aug 01 17:01:32.175632 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 301/611] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:32 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:33.199217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:33.199832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:33.206502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:33.206962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:33.207786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:33.208224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:33.340143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:33.349117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:33.350664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:33.351826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f5ef9db2-5e26-48e9-9f16-cb9b3e8899f5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.156611 Aug 01 17:01:33.352390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 311/612] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:33 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:34.376158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:34.376767 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:34.382944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:34.383771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:34.384144 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:34.384579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:34.529773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:34.542462 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:34.545304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:34.547369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fac1e1f4-e4e0-4c8f-b350-e5def92cdef6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.175367 Aug 01 17:01:34.548340 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 302/613] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:34 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:35.572738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:35.573351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:35.579964 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:35.581241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:35.582043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:35.582488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:35.715851 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:35.724644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:35.726154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:35.727291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-52f188f0-c548-4fb9-a022-dd306c82012b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.158518 Aug 01 17:01:35.727849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 312/614] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:35 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:36.003115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-e773f15e-d245-4767-910c-5142ece0b330 req-518e76f0-2b93-48e4-862a-80baee3813d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "name": "network-vif-plugged", "status": "completed", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:01:36.013926 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e773f15e-d245-4767-910c-5142ece0b330 req-518e76f0-2b93-48e4-862a-80baee3813d1 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.014417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e773f15e-d245-4767-910c-5142ece0b330 req-518e76f0-2b93-48e4-862a-80baee3813d1 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.025080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-e773f15e-d245-4767-910c-5142ece0b330 req-518e76f0-2b93-48e4-862a-80baee3813d1 service nova] Creating event network-vif-plugged:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 17:01:36.030601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-e773f15e-d245-4767-910c-5142ece0b330 req-518e76f0-2b93-48e4-862a-80baee3813d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033989 Aug 01 17:01:36.030935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 303/615] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:01:36.153207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:01:36.155985 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:36.162670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.163152 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.163963 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.164399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.355832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5a93ae2d-55a4-468f-bd0a-468163c2149f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action" status: 202 len: 0 microversion: 2.1 time: 0.207539 Aug 01 17:01:36.356459 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 313/616] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:01:36 2022] POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:01:36.365195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:36.365899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:36.372515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.372971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.373786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.374204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.524425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:36.532387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ab072e19-665b-4da3-83d0-a7a01f9cb5d7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1751 microversion: 2.1 time: 0.171419 Aug 01 17:01:36.532960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 304/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:36 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:36.753003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:36.753837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:36.760190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.760638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.761493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:36.762138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:36.930715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:36.939140 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:36.941031 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:36.942406 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-847b4779-b484-4938-88b0-7ad09e3035f3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.194778 Aug 01 17:01:36.942894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 314/618] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:36 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:37.553972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:37.554612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:37.561740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:37.562227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:37.562983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:37.563418 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:37.715169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:37.727799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-125d716f-41b6-474d-bb6e-252337ea78e9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1751 microversion: 2.1 time: 0.177608 Aug 01 17:01:37.728368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 305/619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:37 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:37.966411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:37.967071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:37.973400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:37.973852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:37.974715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:37.975098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:38.104854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:38.113793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:38.115345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:38.119558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a7ecf5c7-dc6d-4b20-9e31-2433d79f6eb4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.155006 Aug 01 17:01:38.119558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 315/620] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:37 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:38.749776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:38.750518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:38.756520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:38.756966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:38.757723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:38.758188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:38.918313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:38.927110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-68ac74da-bb28-4efd-9f77-b02f69d40faf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.181410 Aug 01 17:01:38.933848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 316/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:38 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:39.044953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32b867cd-239b-4d83-ae22-0ee4910159e7"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:01:39.047553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:39.054162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.054613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:39.055383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.055821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:39.141798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:39.142413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:39.149726 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.150202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:39.150959 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.151390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:39.298102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:39.307780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:39.309358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:39.310563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-25069500-49af-4e7d-a597-64c750bfe70c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.172981 Aug 01 17:01:39.311122 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 317/622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:39 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:39.950271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:39.950622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-33fc65c0-03fc-4081-91e9-a2e585605fde tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209569 Aug 01 17:01:39.950964 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:39.951425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 306/623] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:01:38 2022] POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments => generated 194 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:01:39.957220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.957679 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:39.958571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:39.959012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:40.111099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:40.119686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-07ca28ce-ecf3-4ff7-a691-a2c0b3b71370 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.173453 Aug 01 17:01:40.120270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 318/624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:39 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:01:40.334047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:40.334794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:40.341114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:40.341565 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:40.342354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:40.349995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:40.474628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:40.483198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:40.484745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:40.485910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7f78bcaa-18af-4395-b0bb-1eda4e11ec57 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1806 microversion: 2.20 time: 0.157004 Aug 01 17:01:40.486531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 307/625] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:40 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:41.142090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:41.143464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:41.150020 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:41.150525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:41.151283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:41.151714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:41.295270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:41.303345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-58c04330-4a35-4a18-a179-28e5a4226736 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.165200 Aug 01 17:01:41.303980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 319/626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:41 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:41.510783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:41.511311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:41.518284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:41.518735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:41.519486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:41.519912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:41.650251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:41.658828 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:41.660368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:41.661570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2a8a9ce9-496b-4a1d-a29d-f432ef2484b3 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1793 microversion: 2.20 time: 0.154824 Aug 01 17:01:41.662158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 308/627] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:01:41 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1793 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:01:42.324393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:42.325006 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:42.332452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:42.332902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:42.333676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:42.334152 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:42.476777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:42.484615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6eab926-8d63-41f2-8e94-b181b9afa0ea tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.164104 Aug 01 17:01:42.485181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 320/628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:42 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:43.506401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:43.506911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:43.514829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:43.515275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:43.516030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:43.516459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:43.660507 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:43.668526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-431583a9-7521-451d-8f9f-0fa0b6d18a69 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.166077 Aug 01 17:01:43.669101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 309/629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:43 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:44.690442 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:44.691158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:44.697610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:44.698089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:44.698858 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:44.699294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:44.840250 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:44.848273 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-15601e46-0dab-4163-aaaf-f0f703d88836 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.162380 Aug 01 17:01:44.848878 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 321/630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:44 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:45.870437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:45.870975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:45.873385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=32 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:45.878251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:45.878706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:45.879476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:45.879913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:46.024778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:46.032649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de0a2eec-4dc1-4546-939a-0b81441840d4 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.166448 Aug 01 17:01:46.033795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 310/631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:45 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:47.055118 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:47.055727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:47.062410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:47.062859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:47.063620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:47.064055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:47.206277 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:47.212651 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bedf045e-f39d-4079-aa76-08d94de5aa8e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.161397 Aug 01 17:01:47.213214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 322/632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:47 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:01:48.234190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:48.234714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:48.241706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.242168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:48.242921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.243348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:48.382591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:48.390365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4c104905-2699-44af-a505-d716725818c7 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.160026 Aug 01 17:01:48.390931 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 311/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:48 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:48.529621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:01:48.531917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:48.538390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.538839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:48.539599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.540029 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:48.543787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:48.562741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'flavor' on Instance uuid 51b9e12b-2a9c-47d6-ad05-17f5030e3881 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:01:48.864214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-36c1eb5a-affd-47cc-94ac-245a53ea4e90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/action" status: 200 len: 32 microversion: 2.1 time: 0.338463 Aug 01 17:01:48.864887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 323/634] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:01:48 2022] POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:01:48.874834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:48.875453 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:48.882360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.882808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:48.883579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:48.884016 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:49.014690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:49.023611 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7dbd2a8e-10c0-4c95-bcc0-39f7ae741bb2 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.152590 Aug 01 17:01:49.024584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 312/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:48 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:49.291581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:01:49.291854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:01:49.413240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:49.414026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:49.415936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=40 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:49.421289 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:49.421745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:49.422554 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:49.422994 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:49.627676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:49.635946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8ecb3250-0490-4c43-8b94-52bf43a7b245 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.227153 Aug 01 17:01:49.640763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 324/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:49 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:50.044688 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:50.045474 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:50.052807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:50.053285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:50.054068 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:50.054548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:50.187176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:50.195850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f894bcc2-22ff-49b3-a1a6-b1c9fa3fa627 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.155037 Aug 01 17:01:50.196448 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 313/637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:50 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:50.656990 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:50.657639 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:50.664738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:50.665189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:50.665950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:50.666413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:50.807456 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:50.816043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-04f906aa-094e-4849-a080-a7d3776a6513 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.162854 Aug 01 17:01:50.816609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 325/638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:50 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:51.216627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:51.217231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:51.223768 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:51.224205 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:51.224956 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:51.225384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:51.354862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:51.362996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dc0aad9a-6ff8-49b9-a6b5-12932ade3030 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.150217 Aug 01 17:01:51.363570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 314/639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:51 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:51.836786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:51.837396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:51.843859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:51.844302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:51.845056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:51.845493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:51.987992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:51.996120 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2c9ee817-ae7c-4c9f-b272-689bae15f3cb tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.163117 Aug 01 17:01:51.996679 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 326/640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:51 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:52.385385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:52.385996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:52.393027 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:52.393472 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:52.394263 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:52.394697 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:52.523595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:52.531587 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04f48435-0a43-40d7-bb1a-bb049bc2a2db tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.150384 Aug 01 17:01:52.532197 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 315/641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:52 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:53.017961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:53.018608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:53.025013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:53.025455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:53.026235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:53.026669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:53.172611 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:53.180535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b68afad2-e902-4b8a-9c89-e68801c891f8 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.166933 Aug 01 17:01:53.181095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 327/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:53 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:53.553447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:53.554097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:53.560564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:53.561026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:53.561792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:53.562258 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:53.566803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:53.693208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:53.700970 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9bd16423-d95e-443c-aa42-3b6b0a09cb86 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.151617 Aug 01 17:01:53.701528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 316/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:53 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:54.201642 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:54.202289 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:54.208894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:54.209343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:54.210130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:54.210566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:54.352679 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:54.360775 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e8121dcd-ec3e-4ccc-b50f-5b9f0a45742a tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1756 microversion: 2.1 time: 0.162966 Aug 01 17:01:54.361939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 328/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:54 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:54.723097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:54.723713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:54.730149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:54.730597 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:54.731360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:54.731795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:54.867432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:54.875538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0383d5c-9371-4f71-b004-e2b84da28984 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.156996 Aug 01 17:01:54.876111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 317/645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:54 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:55.383680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:55.384234 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:55.390781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:55.391224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:55.391969 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:55.392444 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:55.536391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:55.544234 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-403bfae7-317b-4b95-845c-49f3fb02638f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1759 microversion: 2.1 time: 0.164511 Aug 01 17:01:55.544797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 329/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:55 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:55.897862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:55.898557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:55.905189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:55.905640 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:55.906447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:55.906888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:56.037144 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:56.045033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04756b98-2ff2-4a6c-ab48-65d2cb27228c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.151051 Aug 01 17:01:56.045601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 318/647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:55 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:56.219094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:56.219581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:56.225635 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:56.226112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:56.226866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:56.227293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:56.348707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lazy-loading 'services' on Instance uuid eac7cea8-b1f2-4104-bb3b-083dcacbf502 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:01:56.601779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-77991704-0b92-4a65-b47b-e4cf489e0785 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments/cb16fb01-bfe8-4b2a-be81-e8a158a1f1a1" status: 202 len: 0 microversion: 2.1 time: 0.544235 Aug 01 17:01:56.602425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 330/648] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:01:56 2022] DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments/cb16fb01-bfe8-4b2a-be81-e8a158a1f1a1 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:01:57.067461 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:57.067980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:57.074514 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:57.074956 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:57.075748 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:57.076175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:57.208582 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:57.216630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-72eedf42-26df-40a3-93cb-0ce43ddefa90 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.153260 Aug 01 17:01:57.217201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 319/649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:57 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:58.240145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:58.241097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:58.247902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:58.248352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:58.249116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:58.249559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:58.380283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:58.388732 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cb97b76d-068d-4d67-9381-fe81d21bfb62 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.153820 Aug 01 17:01:58.389337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 331/650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:58 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:58.776510 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3a100761-398b-45d3-ad28-a62c4bd8493f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:01:58.783103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a100761-398b-45d3-ad28-a62c4bd8493f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:58.783558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3a100761-398b-45d3-ad28-a62c4bd8493f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:58.804903 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3a100761-398b-45d3-ad28-a62c4bd8493f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Going to try to stop instance {{(pid=124837) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 17:01:58.948613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3a100761-398b-45d3-ad28-a62c4bd8493f tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action" status: 202 len: 0 microversion: 2.1 time: 0.175766 Aug 01 17:01:58.949272 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 320/651] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:01:58 2022] POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:01:58.957157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:58.957763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:58.963774 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:58.964162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:58.964919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:58.965345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:59.096715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:59.104171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-af171478-8858-469e-9e32-81aa1fe7dada tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.150767 Aug 01 17:01:59.104746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 332/652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:58 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:01:59.413222 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:01:59.413853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:01:59.420178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:59.420633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:59.421398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:01:59.421837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:01:59.557030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:01:59.565203 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-60fa7ad9-d586-4cc9-b138-68165460bcfe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.156294 Aug 01 17:01:59.565774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 321/653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:01:59 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:00.128070 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:00.128637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:00.135047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:00.135564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:00.136327 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:00.136862 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:00.273923 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:00.282174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5cb5e39c-26ff-4801-b844-fa5efbe5cd72 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.158645 Aug 01 17:02:00.282772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 333/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:00 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:00.585984 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:00.586627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:00.593071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:00.593515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:00.594310 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:00.594808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:00.726116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:00.733986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-47bbd9d6-434c-48db-a190-841c258c6c1a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.151999 Aug 01 17:02:00.734572 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 322/655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:00 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:01.304140 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:01.304754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:01.311411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:01.311860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:01.312625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:01.313138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:01.442065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:01.449423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f29e2ef7-91e3-4080-bb88-7bc963afd6a8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.149256 Aug 01 17:02:01.450475 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 334/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:01 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:01.755616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:01.756149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:01.762528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:01.762966 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:01.763716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:01.764143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:01.893949 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:01.901972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-15b97b36-9405-430f-80b2-54230a1119a6 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.150209 Aug 01 17:02:01.902872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 323/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:01 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:02.469707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:02.470342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:02.477326 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:02.477779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:02.478577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:02.479047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:02.610920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:02.619332 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c61c25e2-6d8d-4885-a7a7-71170213f897 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.153506 Aug 01 17:02:02.619901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 335/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:02 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:02.924120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:02.924709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:02.931551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:02.932065 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:02.932832 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:02.933265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:03.067755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:03.076385 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0b462f82-972c-44b5-8195-6e4609674800 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.156640 Aug 01 17:02:03.076962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 324/659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:02 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:03.639438 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:03.640080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:03.647477 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:03.647959 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:03.648725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:03.649160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:03.776978 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:03.784460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-edac0609-8c83-4db7-8d56-cfae431a8961 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.148895 Aug 01 17:02:03.785024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 336/660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:03 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:04.098336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:04.099006 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:04.105476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:04.105913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:04.106692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:04.107117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:04.239355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:04.247717 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ffab2ac1-1516-4f1a-aa80-4e94685f0b7a tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.153304 Aug 01 17:02:04.248300 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 325/661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:04 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:04.805507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:04.806144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:04.812740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:04.813188 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:04.813948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:04.815029 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:04.819224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:04.951486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:04.958960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-39b571a0-5130-4491-83f8-9efda4c57372 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.157341 Aug 01 17:02:04.959523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 337/662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:04 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:05.268252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:05.269013 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:05.275604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:05.276111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:05.276871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:05.277307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:05.406300 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:05.414656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6210d70a-8b56-432b-b34e-f9fd0cd61ac9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.150217 Aug 01 17:02:05.415220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 326/663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:05 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:05.979718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:05.980326 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:05.986818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:05.987270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:05.988798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:05.989227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:06.119443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:06.126771 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a07a9dea-4d3b-44e8-9319-28ec19057445 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.150954 Aug 01 17:02:06.127333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 338/664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:05 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:06.436624 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:06.437231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:06.444422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:06.444869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:06.445641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:06.446091 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:06.575902 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:06.584548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d99cf67f-efa3-4fb7-987e-8f2d0673d5fe tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.151752 Aug 01 17:02:06.587862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 327/665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:06 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:07.148762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:07.149392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:07.155322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:07.155763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:07.156508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:07.156959 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:07.285856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:07.293248 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9ca7ac33-50c7-4972-afb6-ccefd309fce2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.148603 Aug 01 17:02:07.293805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 339/666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:07 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:07.606472 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:07.607084 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:07.614247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:07.614697 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:07.615463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:07.616152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:07.742483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:07.753637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d2d93a34-e43f-4aad-a6d3-ba0c254856a0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.147775 Aug 01 17:02:07.753637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 328/667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:07 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:08.313638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:08.314197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:08.321468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:08.322000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:08.322779 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:08.323212 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:08.451279 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:08.459364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-61562b9b-5d81-4392-b14a-b8907ca7b3a1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.149571 Aug 01 17:02:08.459934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 340/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:08 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:08.773009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:08.773625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:08.780218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:08.780662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:08.781426 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:08.781865 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:08.908256 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:08.916152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0af52543-275f-4f02-a596-3e20ece7dbbd tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1733 microversion: 2.1 time: 0.147349 Aug 01 17:02:08.916756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 329/669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:08 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:09.480578 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:09.481133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:09.487583 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:09.488220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:09.489013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:09.489448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:09.620320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:09.627677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dbee4023-d51c-47b5-98b7-125ac1fd1111 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.151029 Aug 01 17:02:09.628931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:09 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:09.937574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:09.938248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:09.945037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:09.945491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:09.946301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:09.946786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.077878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:10.085918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4eb9b6c-25be-4a86-a7b0-f462b965893b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1713 microversion: 2.1 time: 0.152561 Aug 01 17:02:10.086523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:09 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:10.193061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:10.193559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:10.199746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.200205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.200971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.201408 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.281239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] HTTP exception thrown: Cannot 'detach_volume' instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 while it is in vm_state rescued Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Request method failure captured: Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments/32b867cd-239b-4d83-ae22-0ee4910159e7 HTTP/1.1 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVuTp1cjRXSsjnVLuWdfKw2MyFRF9Yaa0YCWVsV5c5BXAzW7gUOYKqgzMSCEXKqdp_0KiE-3fH7MVYhZjQvjEcWcyeR_jaW8HyWJsuwU2waAIXkEDhn6_fIbISqqjH1T8SBmYaxHlmVD9DpLxlm-FEZqj-Mq_Mu3aiav6E_9FrtR14 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:02:10.282857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64929e340dae4c0f90162702aab5bc21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b353fdd302394227987a6ae8c2943173 Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:02:10.284282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Cannot 'detach_volume' instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 while it is in vm_state rescued Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'server_id': '51b9e12b-2a9c-47d6-ad05-17f5030e3881', 'id': '32b867cd-239b-4d83-ae22-0ee4910159e7'} Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:02:10.285005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 while it is in vm_state rescued Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 while it is in vm_state rescued Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:02:10.286756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Returning 409 to user: Cannot 'detach_volume' instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 while it is in vm_state rescued {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:02:10.288743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fbb9f089-3415-464d-832b-ea4b4f5f2698 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments/32b867cd-239b-4d83-ae22-0ee4910159e7" status: 409 len: 152 microversion: 2.1 time: 0.095498 Aug 01 17:02:10.288743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 342/672] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:02:10 2022] DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments/32b867cd-239b-4d83-ae22-0ee4910159e7 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 17:02:10.293974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:02:10.294533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:10.300587 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.300922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.301671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.302124 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.328400 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:10.474945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-84cb297d-1c13-4345-b02f-cac73ece0d8c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/action" status: 202 len: 0 microversion: 2.1 time: 0.184468 Aug 01 17:02:10.475446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 331/673] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:02:10 2022] POST /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:02:10.484400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:10.485004 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:10.492819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.493262 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.494051 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.494484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.653191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:10.654087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:10.660611 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.662853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.662853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:10.662853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:10.663575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:10.672127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d417ec6e-2777-43d4-a0d4-10cf03a9eb6f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1721 microversion: 2.1 time: 0.192133 Aug 01 17:02:10.673024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:10 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:10.796663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:10.805159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8e5d98bb-e0c0-4c95-bc45-99f2f418ce15 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.156964 Aug 01 17:02:10.805734 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 332/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:10 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:11.694622 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:11.695171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:11.701550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:11.701994 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:11.702782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:11.703217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:11.826317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:11.826933 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:11.832026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:11.833407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:11.833861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:11.834664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:11.835102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:11.839929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-81224921-55ea-4077-810a-ea4857cbf087 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1721 microversion: 2.1 time: 0.150095 Aug 01 17:02:11.840493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 344/676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:11 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:11.968107 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:11.976390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ab248e3f-368d-4852-9de6-34a33518f4b7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.153917 Aug 01 17:02:11.977414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 333/677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:11 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:12.860711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:12.861319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:12.869007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:12.869459 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:12.870265 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:12.870703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:12.997412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:12.998045 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:13.003917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:13.007159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:13.007159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:13.007159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:13.007159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:13.012005 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-57bb1fad-9c79-4484-b802-0355d5ba7824 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1721 microversion: 2.1 time: 0.155044 Aug 01 17:02:13.012569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 345/678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:12 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:13.134163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:13.141554 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-feb97a43-113a-4066-a38c-b9041706c13c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.148072 Aug 01 17:02:13.142145 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 334/679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:12 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:14.033280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:14.033897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:14.041064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:14.041594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:14.042391 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:14.042831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:14.163751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:14.164267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:14.171050 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:14.171675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:14.172166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:14.172439 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:14.172869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:14.180898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-44333dec-2148-40a3-890b-3a03eb016e04 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1721 microversion: 2.1 time: 0.151458 Aug 01 17:02:14.181467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 346/680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:14 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:14.303849 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:14.311342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f82806a8-794a-47da-a9b3-fcd2d1b39e83 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.151739 Aug 01 17:02:14.311905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 335/681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:14 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:15.203181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:15.203747 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:15.210941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.211311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.212055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.212489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.333363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:15.333972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:15.340470 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.340918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.341244 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:15.341682 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.342133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.349512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6dff227b-2214-4253-a977-0b5997391167 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1727 microversion: 2.1 time: 0.150222 Aug 01 17:02:15.350628 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 347/682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:15 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:15.371201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:15.371691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:15.377566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.378689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.379466 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:15.379900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:15.460452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0c7b1b35-224a-4888-a1b3-483429e99e01 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093130 Aug 01 17:02:15.461037 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 348/683] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:02:15 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:02:15.474431 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:15.481857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-427dc2da-c39b-49e5-87c2-484243e2f0f2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.153007 Aug 01 17:02:15.482451 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 336/684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:15 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:16.408712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-6bc4c9da-9463-47b5-a513-10db555fbdf2 req-c37e6e90-b28b-496c-99c7-8c97cd6e1f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:02:16.418987 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-6bc4c9da-9463-47b5-a513-10db555fbdf2 req-c37e6e90-b28b-496c-99c7-8c97cd6e1f4d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:16.419563 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-6bc4c9da-9463-47b5-a513-10db555fbdf2 req-c37e6e90-b28b-496c-99c7-8c97cd6e1f4d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:16.431750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-6bc4c9da-9463-47b5-a513-10db555fbdf2 req-c37e6e90-b28b-496c-99c7-8c97cd6e1f4d service nova] Creating event network-changed:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 17:02:16.437138 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-6bc4c9da-9463-47b5-a513-10db555fbdf2 req-c37e6e90-b28b-496c-99c7-8c97cd6e1f4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031981 Aug 01 17:02:16.437744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 349/685] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:02:16.504827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:16.505450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:16.508953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=54 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:16.512943 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:16.513635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:16.514670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:16.515288 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:16.656386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:16.666460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4712e23f-d28d-44c7-b05b-498e91ddbd33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.166068 Aug 01 17:02:16.667441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 337/686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:16 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:17.688884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:17.689589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:17.695999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:17.696447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:17.697207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:17.697643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:17.824866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:17.833096 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-54d037f2-8cf8-4b2e-8f9a-f66ab940960d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.148842 Aug 01 17:02:17.833672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 350/687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:17 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:18.451808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-2830533f-4137-4ae4-ae2c-02604061e835 req-2152f2dd-c723-4338-9b1f-73535e4689be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:02:18.462352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2830533f-4137-4ae4-ae2c-02604061e835 req-2152f2dd-c723-4338-9b1f-73535e4689be service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:18.462793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2830533f-4137-4ae4-ae2c-02604061e835 req-2152f2dd-c723-4338-9b1f-73535e4689be service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:18.473834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-2830533f-4137-4ae4-ae2c-02604061e835 req-2152f2dd-c723-4338-9b1f-73535e4689be service nova] Creating event network-changed:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 17:02:18.478725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-2830533f-4137-4ae4-ae2c-02604061e835 req-2152f2dd-c723-4338-9b1f-73535e4689be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 Aug 01 17:02:18.479309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 338/688] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:02:18.854078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:18.854686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:18.861344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:18.861796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:18.863214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:18.863838 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:19.076028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:19.084866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a6cb1e2b-f280-43ae-8694-cd6bb137aad7 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1678 microversion: 2.1 time: 0.234654 Aug 01 17:02:19.085880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 351/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:18 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:02:20.107899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:20.108629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:20.115579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:20.116286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:20.117045 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:20.117482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:20.250995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:20.258325 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4879452c-1f0a-4684-9d4b-8c30adf6e9ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1655 microversion: 2.1 time: 0.155253 Aug 01 17:02:20.258888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 339/690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:20 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:20.278482 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2edddcce-ac38-453c-a741-6c310608b83e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:02:20.281015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=56 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:20.286558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2edddcce-ac38-453c-a741-6c310608b83e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:20.287000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2edddcce-ac38-453c-a741-6c310608b83e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:20.309180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2edddcce-ac38-453c-a741-6c310608b83e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Going to try to start instance {{(pid=124835) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 17:02:20.479736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2edddcce-ac38-453c-a741-6c310608b83e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action" status: 202 len: 0 microversion: 2.1 time: 0.204633 Aug 01 17:02:20.480342 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 352/691] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:02:20 2022] POST /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:02:20.489803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:20.490458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:20.496834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:20.501436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:20.501436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:20.501436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:20.628594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:20.636465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-72bed1a3-10d2-4d78-9c59-55ef1c2c2ed1 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1664 microversion: 2.1 time: 0.151528 Aug 01 17:02:20.637038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 340/692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:20 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:21.658390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:21.659784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:21.666465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:21.668881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:21.668881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:21.668881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:21.800801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:21.804434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:21.808820 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c6e0c1b6-b515-4393-9b81-d307b6d23f2a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1664 microversion: 2.1 time: 0.154834 Aug 01 17:02:21.809428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 353/693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:21 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:22.831557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:22.832175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:22.838209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:22.838660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:22.839422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:22.839862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:22.970888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:02:22.979142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b8b4b13e-8045-4bb1-a6c8-fcd78cd63236 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1668 microversion: 2.1 time: 0.151787 Aug 01 17:02:22.984425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 341/694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:02:22 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:02:58.383643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:58.563576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:58.564076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:58.570310 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.570755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.571514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.571945 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.599100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d9460f12-d287-405a-b061-91a8416cbaf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments/478b4f06-11a7-40a7-b645-300e0ce3ffd4" status: 200 len: 194 microversion: 2.20 time: 0.222339 Aug 01 17:02:58.600174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 354/695] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Aug 1 17:02:58 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments/478b4f06-11a7-40a7-b645-300e0ce3ffd4 => generated 194 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 17:02:58.667055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:58.667568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:58.669887 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=9 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:58.670575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:02:58.675217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.675661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.676416 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.676845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.756215 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lazy-loading 'services' on Instance uuid 2afc4567-0ddd-4f00-b501-0ee07c12677d {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:02:58.950003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59184cfd-9379-4f2c-a2ee-8e34c20fe4b0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments/478b4f06-11a7-40a7-b645-300e0ce3ffd4" status: 202 len: 0 microversion: 2.20 time: 0.286592 Aug 01 17:02:58.950629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 342/696] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 1 17:02:58 2022] DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments/478b4f06-11a7-40a7-b645-300e0ce3ffd4 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:02:58.960064 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:02:58.962454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:02:58.968399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.968854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.969690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:02:58.970159 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:02:58.999526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f97ab40d-b22d-4fba-ad48-64d5703519d7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044075 Aug 01 17:02:59.000092 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 355/697] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 1 17:02:58 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 17:03:00.013337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:00.015678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:00.022191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:00.022647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:00.023427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:00.023864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:00.056528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8e7c342b-6373-48ff-85a2-65383602f437 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048128 Aug 01 17:03:00.057664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 343/698] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 1 17:03:00 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 17:03:01.069861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:01.072116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:01.078462 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.078907 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.079680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.080103 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.107344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e73a1ec4-c31a-48d3-8cc1-b84c6aebdeae tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042158 Aug 01 17:03:01.107891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 356/699] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 1 17:03:01 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:01.169620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:01.170158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:01.176614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.177063 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.178607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.179041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.204032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:01.419322 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-194caf0f-0fca-4eff-93d5-af00b387cdf7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 204 len: 0 microversion: 2.20 time: 0.253318 Aug 01 17:03:01.420019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 344/700] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 1 17:03:01 2022] DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 17:03:01.439453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:01.440068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:01.446200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.446649 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.447436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:01.447871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:01.580189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:01.588063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:01.589552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:01.590725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-de6c0e78-9bdd-4969-bb7d-029c78e355f6 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.155246 Aug 01 17:03:01.591281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 357/701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:01 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:03:02.615393 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:02.616451 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:02.622906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:02.623349 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:02.624098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:02.624528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:02.753041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:02.761574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:02.763144 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:02.764347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6c521961-2fed-43db-a91c-2b1c61e40a40 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.153736 Aug 01 17:03:02.764912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 345/702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:02 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:03.787660 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:03.788282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:03.794867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:03.795318 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:03.796080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:03.796513 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:03.988388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:03.997101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:03.998635 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:03.999934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-205c6e84-6677-4c46-a167-4ee90cac0c03 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1721 microversion: 2.20 time: 0.216349 Aug 01 17:03:04.000351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 358/703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:03 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:04.400111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-305c6cad-3c13-4e07-9dc4-851aeb937601 req-751c98c4-92fd-41bc-85dd-54d0891f413c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afc4567-0ddd-4f00-b501-0ee07c12677d", "name": "network-vif-deleted", "tag": "a3531460-f518-48d7-8d23-d01e8e61be4a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:04.410907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-305c6cad-3c13-4e07-9dc4-851aeb937601 req-751c98c4-92fd-41bc-85dd-54d0891f413c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:04.416673 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-305c6cad-3c13-4e07-9dc4-851aeb937601 req-751c98c4-92fd-41bc-85dd-54d0891f413c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:04.424941 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-305c6cad-3c13-4e07-9dc4-851aeb937601 req-751c98c4-92fd-41bc-85dd-54d0891f413c service nova] Creating event network-vif-deleted:a3531460-f518-48d7-8d23-d01e8e61be4a for instance 2afc4567-0ddd-4f00-b501-0ee07c12677d on hv-cinder-84989 Aug 01 17:03:04.431409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-305c6cad-3c13-4e07-9dc4-851aeb937601 req-751c98c4-92fd-41bc-85dd-54d0891f413c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 Aug 01 17:03:04.432286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 346/704] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:05.023838 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:05.024580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:05.031354 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:05.031968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:05.032808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:05.033317 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:05.066264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:05.067019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:05.067675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lazy-loading 'fault' on Instance uuid 2afc4567-0ddd-4f00-b501-0ee07c12677d {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:05.120704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:05.129288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:05.135845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:05.135845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d01f7f69-2e77-4bb5-90fc-537641fce99b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 200 len: 1369 microversion: 2.20 time: 0.112983 Aug 01 17:03:05.135845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 359/705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:05 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:06.156192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:06.156936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:06.164817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:06.165190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:06.166015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:06.166481 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:06.183458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d HTTP/1.1 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:03:06.185165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:03:06.186749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '2afc4567-0ddd-4f00-b501-0ee07c12677d'} Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:06.187617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:03:06.188872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:06.190074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:06.190074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4812fa9d-3356-43d5-9f48-ea082c6bf7be tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 404 len: 111 microversion: 2.20 time: 0.034830 Aug 01 17:03:06.190074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 347/706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:06 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:03:06.195946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-18b38a72-63be-4bd2-b40a-8f51b9b88976 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '.version_select at 0x7f733daf4550>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:06.317334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-18b38a72-63be-4bd2-b40a-8f51b9b88976 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-432608160" status: 204 len: 0 microversion: 2.20 time: 0.125247 Aug 01 17:03:06.318271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 360/707] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 1 17:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-432608160 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 17:03:07.153939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0040bdd1-3bf6-4c53-97c6-9186c7ba8896 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: .version_select at 0x7f733d8933a0>, body: {"keypair": {"name": "tempest-keypair-1000802603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa6kcAH7ZIikA9cqrGIe6uT3Zl1CL171EnrtFIltw87ELtzYtWssI2xlUvJ1hK3oHfsvPD41Z4i8FNfZiCgXskczlf+mF7Xv4zYEZU+H16m3HGSdNYoUOARlJmtmcwp9Q=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:07.169011 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-0040bdd1-3bf6-4c53-97c6-9186c7ba8896 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for project dfc1c3badb144d24a2b86341a155505a. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:03:07.172751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-0040bdd1-3bf6-4c53-97c6-9186c7ba8896 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for user 48cc0715e7b04f8a8c9f0d8c455bd4c6 and project dfc1c3badb144d24a2b86341a155505a. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:03:07.254715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0040bdd1-3bf6-4c53-97c6-9186c7ba8896 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.104675 Aug 01 17:03:07.255337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 348/708] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 1 17:03:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 17:03:07.977696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1408294343"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:07.978264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:07.984228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:07.986208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:07.986208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:07.986208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:08.148898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.network.security_group_api [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Removing security group bf2694ec-fd0b-42d0-8a03-5b17c6797c02 from port 6ce55c64-693a-4185-b2a9-7c3b3f6a4436 Aug 01 17:03:08.561682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-55e61171-a4c3-4a47-bd63-bbaa2fb2a7b0 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action" status: 202 len: 0 microversion: 2.1 time: 0.713430 Aug 01 17:03:08.566161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 361/709] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:03:07 2022] POST /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:08.586391 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-af57bded-4ff6-421a-82bd-9308bf7ca466 req-76fbe220-1040-4a15-81f2-8de8eed3b2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:08.599448 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-af57bded-4ff6-421a-82bd-9308bf7ca466 req-76fbe220-1040-4a15-81f2-8de8eed3b2d4 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:08.600259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-af57bded-4ff6-421a-82bd-9308bf7ca466 req-76fbe220-1040-4a15-81f2-8de8eed3b2d4 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:08.614591 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-af57bded-4ff6-421a-82bd-9308bf7ca466 req-76fbe220-1040-4a15-81f2-8de8eed3b2d4 service nova] Creating event network-changed:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 17:03:08.623107 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-af57bded-4ff6-421a-82bd-9308bf7ca466 req-76fbe220-1040-4a15-81f2-8de8eed3b2d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039668 Aug 01 17:03:08.623995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 349/710] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:09.667945 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1587013459", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "680c38bc-09b1-4d5d-b6e3-97006e991feb"}], "security_groups": [{"name": "tempest-securitygroup--1494964469"}], "key_name": "tempest-keypair-1000802603", "user_data": "}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:09.798886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] validate_networks() for [('680c38bc-09b1-4d5d-b6e3-97006e991feb', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:03:10.592308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:03:10.593550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:03:10.594502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:03:10.595105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:03:10.604211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:03:10.605810 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:10.606514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:10.607481 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:10.608097 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:10.628679 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for project dfc1c3badb144d24a2b86341a155505a. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:03:10.633908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Getting quotas for user 48cc0715e7b04f8a8c9f0d8c455bd4c6 and project dfc1c3badb144d24a2b86341a155505a. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:03:10.646741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:03:10.649691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:03:10.787111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-23dfc1a7-c554-45b2-b6ba-e1f032a52e05 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.124043 Aug 01 17:03:10.788273 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 362/711] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 1 17:03:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 17:03:10.799653 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:10.800351 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:10.916037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:10.939945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:10.941044 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:10.943146 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a1867730-8b9c-400f-a5a4-11f4500097a2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1282 microversion: 2.20 time: 0.147788 Aug 01 17:03:10.954132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 350/712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:10 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:03:10.964422 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:10.964930 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:10.971208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-f581b463-337a-4973-ab2f-427814a2ee67 req-70429240-3a6a-45f6-b48c-791534b82790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:10.976170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:10.976602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:10.977401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:10.977842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:10.982660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f581b463-337a-4973-ab2f-427814a2ee67 req-70429240-3a6a-45f6-b48c-791534b82790 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:10.983384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f581b463-337a-4973-ab2f-427814a2ee67 req-70429240-3a6a-45f6-b48c-791534b82790 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:10.995388 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-f581b463-337a-4973-ab2f-427814a2ee67 req-70429240-3a6a-45f6-b48c-791534b82790 service nova] Creating event network-changed:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 17:03:11.000534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-f581b463-337a-4973-ab2f-427814a2ee67 req-70429240-3a6a-45f6-b48c-791534b82790 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Aug 01 17:03:11.001405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 351/713] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:11.086408 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lazy-loading 'services' on Instance uuid 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:11.413767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1c662fe0-9cf1-4041-ba18-b6f5814f49d9 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments/35b96ba9-bfa9-489b-9846-9eaea368c86b" status: 202 len: 0 microversion: 2.1 time: 0.454562 Aug 01 17:03:11.414400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 363/714] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:03:10 2022] DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments/35b96ba9-bfa9-489b-9846-9eaea368c86b => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:11.423234 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:11.425907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:11.433089 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:11.433666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:11.434718 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:11.435364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:11.466827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a245e2bb-c7a1-43a1-967c-c2d245de6590 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Aug 01 17:03:11.467996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 352/715] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:11 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:03:11.967323 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:11.968283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:11.975500 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:11.975945 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:11.976715 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:11.977143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:12.047428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:12.056656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:12.058172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:12.059275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c5f1c486-0ee6-486a-8c0f-674deb20838d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1286 microversion: 2.20 time: 0.096174 Aug 01 17:03:12.059835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 364/716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:11 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:12.480191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:12.482352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:12.489057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:12.489507 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:12.491209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:12.491641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:12.523189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-17aac21f-7b83-45c0-8885-ed227aac53bf tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 Aug 01 17:03:12.523770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 353/717] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:12 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:03:13.082546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:13.083140 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:13.091612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.092058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.092828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.094238 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.187640 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:13.197469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:13.199279 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:13.200685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-769c1f84-95a1-4454-a208-7d6712066f90 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1342 microversion: 2.20 time: 0.122128 Aug 01 17:03:13.201469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 365/718] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:13 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:13.540997 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:13.543267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:13.550007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.550500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.551274 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.551704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.581647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfe5e93d-497f-4f0e-827c-6952342e98df tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045315 Aug 01 17:03:13.582238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 354/719] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:13 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:03:13.592670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:13.593160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:13.599699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.600147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.601350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:13.601470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:13.678922 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] HTTP exception thrown: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef is not attached to volume 35b96ba9-bfa9-489b-9846-9eaea368c86b Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Request method failure captured: Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments/35b96ba9-bfa9-489b-9846-9eaea368c86b HTTP/1.1 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AX1iKfHF5Baut5EtUeXICxPcz9C9KvSNeeu0xwoC-sIJsIz_FJOb95z0nnuzpcXaxfXvKB-2-6pWoRRLEThoWs03e5cr9siYPWmEAWt-HpYhPkxo1F-q9FmsoD16lCFTBeiayfWNP_KGJPZiju7X7G-CTWsTwSYa-xSlv61LXdF9XE Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: d9fb92139d3643b2bb7ed4bfed2eae67 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:03:13.681296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: d9fb92139d3643b2bb7ed4bfed2eae67 Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestMinimumBasicScenario-100060363-project Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b2d83a4ae8684f3183756b2dcfc4d514 Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestMinimumBasicScenario-100060363-project Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:03:13.682850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef is not attached to volume 35b96ba9-bfa9-489b-9846-9eaea368c86b Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'server_id': '2ddea4a1-93be-4c6a-9ccd-39c0b38dafef', 'id': '35b96ba9-bfa9-489b-9846-9eaea368c86b'} Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35b96ba9-bfa9-489b-9846-9eaea368c86b. Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:13.683676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef is not attached to volume 35b96ba9-bfa9-489b-9846-9eaea368c86b Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef is not attached to volume 35b96ba9-bfa9-489b-9846-9eaea368c86b Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:13.685744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Returning 404 to user: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef is not attached to volume 35b96ba9-bfa9-489b-9846-9eaea368c86b {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:13.687173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-00dc6119-79ca-4b3b-bb9b-e511e6556b67 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments/35b96ba9-bfa9-489b-9846-9eaea368c86b" status: 404 len: 154 microversion: 2.1 time: 0.094108 Aug 01 17:03:13.687173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 366/720] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:03:13 2022] DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef/os-volume_attachments/35b96ba9-bfa9-489b-9846-9eaea368c86b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:03:14.225642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:14.226586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:14.232978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:14.233334 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:14.234163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:14.234770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:14.378133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:14.387871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:14.389628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:14.390821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a7c5e4f0-5aef-4c81-b46d-2e6d5800b2cc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.169766 Aug 01 17:03:14.391622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 355/721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:14 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:14.929618 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:14.930182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:14.937113 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:14.937551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:14.942889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:14.942889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:14.964084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:15.118495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-34337b41-d829-43b4-91dc-b7531e539e25 req-4b1947ee-37ae-4087-aabd-165ee344f682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:15.128438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-34337b41-d829-43b4-91dc-b7531e539e25 req-4b1947ee-37ae-4087-aabd-165ee344f682 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:15.128873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-34337b41-d829-43b4-91dc-b7531e539e25 req-4b1947ee-37ae-4087-aabd-165ee344f682 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:15.140604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-34337b41-d829-43b4-91dc-b7531e539e25 req-4b1947ee-37ae-4087-aabd-165ee344f682 service nova] Creating event network-changed:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:03:15.145552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-34337b41-d829-43b4-91dc-b7531e539e25 req-4b1947ee-37ae-4087-aabd-165ee344f682 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031785 Aug 01 17:03:15.147550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 356/722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:03:15.281834 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-17de0f5f-b68d-4047-b978-d54315e6a93e tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 204 len: 0 microversion: 2.1 time: 0.356698 Aug 01 17:03:15.282541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 367/723] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:03:14 2022] DELETE /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 17:03:15.291404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:15.292188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:15.300055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:15.300606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:15.301421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:15.301887 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:15.419135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:15.419843 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:15.425829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:15.426320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:15.427609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:15.428065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:15.433548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:15.441314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b20b01c6-09d8-4f3e-9a93-08ae57772094 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1553 microversion: 2.1 time: 0.154298 Aug 01 17:03:15.441886 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 357/724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:15 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:15.561306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:15.569538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:15.571065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:15.572179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d3b2938c-d4a2-49e9-bf59-c98a719e5ac4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.157449 Aug 01 17:03:15.572753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 368/725] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:15 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:03:16.463551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:16.464563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:16.471026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:16.471474 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:16.472302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:16.472771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:16.594877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:16.595594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:16.602252 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:16.602771 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:16.603542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:16.603980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:16.605982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:16.613326 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-af18dfcb-8adc-4247-81bf-3e17c2afe0f6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1553 microversion: 2.1 time: 0.153701 Aug 01 17:03:16.613904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 358/726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:16 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:16.819528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:16.823268 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:16.828060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:16.832177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:16.832177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dfd68435-ae58-4ba4-85a4-e1a05b13135c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.239615 Aug 01 17:03:16.832177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 369/727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:16 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:03:17.635099 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:17.635694 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:17.642176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:17.642622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:17.643414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:17.643850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:17.773339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:17.781649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04254f7c-b2b6-4934-a761-e4d45876a74f tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1553 microversion: 2.1 time: 0.150367 Aug 01 17:03:17.782313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 359/728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:17 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:17.854004 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:17.854660 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:17.861299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:17.861743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:17.862525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:17.862955 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:17.993081 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:18.000852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:18.002369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:18.003458 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d8a411ca-8367-40c0-a1f3-b5c8902c38df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.154433 Aug 01 17:03:18.004011 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 370/729] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:17 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:18.804132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:18.804737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:18.811162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:18.811604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:18.812352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:18.812779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:18.941080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:18.948975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c8e32553-194a-45f3-9090-122db4b064ca tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1553 microversion: 2.1 time: 0.148673 Aug 01 17:03:18.949549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 360/730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:18 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:19.026855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:19.027465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:19.033932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:19.034412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:19.035169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:19.035606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:19.167865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:19.175734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:19.177281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:19.178396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-aa634449-5443-46f2-a221-fc45fcf2527a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.155368 Aug 01 17:03:19.178946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 371/731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:19 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:19.970675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:19.971305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:19.978248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:19.978723 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:19.979487 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:19.979948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:19.999495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:20.114424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:20.122614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-84495a49-e797-439a-85c5-80a72ffc92e6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1553 microversion: 2.1 time: 0.155852 Aug 01 17:03:20.123185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 361/732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:19 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:20.200755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:20.201297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:20.207880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:20.208388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:20.209172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:20.209622 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:20.409827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:20.420142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:20.422294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-ff8d89d0-0997-4f9e-8abd-44a24011a0ff req-458aa824-a8ed-44ea-814e-f980c2c55fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddea4a1-93be-4c6a-9ccd-39c0b38dafef", "name": "network-vif-deleted", "tag": "6ce55c64-693a-4185-b2a9-7c3b3f6a4436"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:20.422439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:20.422942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-40dbd0fe-9129-4b91-98e4-e183cc533cee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.226284 Aug 01 17:03:20.423672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 372/733] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:20 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:20.439625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ff8d89d0-0997-4f9e-8abd-44a24011a0ff req-458aa824-a8ed-44ea-814e-f980c2c55fce service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:20.440078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ff8d89d0-0997-4f9e-8abd-44a24011a0ff req-458aa824-a8ed-44ea-814e-f980c2c55fce service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:20.451563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-ff8d89d0-0997-4f9e-8abd-44a24011a0ff req-458aa824-a8ed-44ea-814e-f980c2c55fce service nova] Creating event network-vif-deleted:6ce55c64-693a-4185-b2a9-7c3b3f6a4436 for instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef on hv-cinder-84989 Aug 01 17:03:20.456593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-ff8d89d0-0997-4f9e-8abd-44a24011a0ff req-458aa824-a8ed-44ea-814e-f980c2c55fce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039532 Aug 01 17:03:20.457495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 362/734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:21.144662 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:21.149091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:21.149091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.149091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.153034 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:21.153487 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:21.154288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:21.154725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:21.186192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:21.186647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:21.187109 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lazy-loading 'fault' on Instance uuid 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:21.230170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d83a4ae8684f3183756b2dcfc4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fb92139d3643b2bb7ed4bfed2eae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:21.237629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ea724623-bac9-42c7-a18a-a8d532ff7c3d tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 200 len: 1347 microversion: 2.1 time: 0.096836 Aug 01 17:03:21.238212 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 373/735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:21 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:21.444701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:21.449375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:21.450209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:21.456626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:21.457083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:21.457865 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:21.458954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:21.588670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:21.596657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:21.598208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:21.599930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-31790dde-2ade-46d8-bce6-fb94a238d7d8 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.156609 Aug 01 17:03:21.600504 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 363/736] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:21 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:22.260026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:22.260625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] [instance: 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:22.268004 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:22.268449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:22.269204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:22.269636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:22.284737 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] HTTP exception thrown: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Request method failure captured: Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef HTTP/1.1 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AX1iKfHF5Baut5EtUeXICxPcz9C9KvSNeeu0xwoC-sIJsIz_FJOb95z0nnuzpcXaxfXvKB-2-6pWoRRLEThoWs03e5cr9siYPWmEAWt-HpYhPkxo1F-q9FmsoD16lCFTBeiayfWNP_KGJPZiju7X7G-CTWsTwSYa-xSlv61LXdF9XE Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: d9fb92139d3643b2bb7ed4bfed2eae67 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:03:22.286359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9fb92139d3643b2bb7ed4bfed2eae67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: d9fb92139d3643b2bb7ed4bfed2eae67 Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestMinimumBasicScenario-100060363 Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestMinimumBasicScenario-100060363-project Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b2d83a4ae8684f3183756b2dcfc4d514 Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestMinimumBasicScenario-100060363-project Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. Aug 01 17:03:22.288134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '2ddea4a1-93be-4c6a-9ccd-39c0b38dafef'} Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:22.288951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. Aug 01 17:03:22.290473 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:22.292078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Returning 404 to user: Instance 2ddea4a1-93be-4c6a-9ccd-39c0b38dafef could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:22.292078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e2540830-f35c-4e51-8ea3-1af8176f2679 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef" status: 404 len: 111 microversion: 2.1 time: 0.032509 Aug 01 17:03:22.292078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 374/737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:22 2022] GET /compute/v2.1/servers/2ddea4a1-93be-4c6a-9ccd-39c0b38dafef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:03:22.296436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-30f98a76-7c26-4a5d-b51f-5d6b962aa1c6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] Calling method '.version_select at 0x7f733d875e50>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:22.368695 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-30f98a76-7c26-4a5d-b51f-5d6b962aa1c6 tempest-TestMinimumBasicScenario-100060363 tempest-TestMinimumBasicScenario-100060363-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-96049143" status: 202 len: 0 microversion: 2.1 time: 0.075981 Aug 01 17:03:22.369303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 364/738] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Aug 1 17:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-96049143 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:22.609818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-a27d93b2-1f26-410a-aa2a-04a0725bbc23 req-dd3020b3-cdcd-4b59-a396-3414d9cf62f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "name": "network-vif-plugged", "status": "completed", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:22.620454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-a27d93b2-1f26-410a-aa2a-04a0725bbc23 req-dd3020b3-cdcd-4b59-a396-3414d9cf62f9 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:22.620904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-a27d93b2-1f26-410a-aa2a-04a0725bbc23 req-dd3020b3-cdcd-4b59-a396-3414d9cf62f9 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:22.623156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:22.623770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:22.630921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:22.631367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:22.632130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:22.632564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:22.632950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-a27d93b2-1f26-410a-aa2a-04a0725bbc23 req-dd3020b3-cdcd-4b59-a396-3414d9cf62f9 service nova] Creating event network-vif-plugged:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:03:22.646763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-a27d93b2-1f26-410a-aa2a-04a0725bbc23 req-dd3020b3-cdcd-4b59-a396-3414d9cf62f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Aug 01 17:03:22.646763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 375/739] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:03:22.775085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:22.783617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:22.785217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:22.786903 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2c46afb5-93d7-49b0-aecb-3ada3c1a7fcc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.167604 Aug 01 17:03:22.798655 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 365/740] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:22 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:03:23.811754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:23.812455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:23.818610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:23.819060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:23.819830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:23.820260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:23.957360 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:23.966663 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:23.968294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:23.969400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-426ee9ba-ee16-4c1d-82ce-b37c56c66d64 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1408 microversion: 2.20 time: 0.162610 Aug 01 17:03:23.969948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 376/741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:23 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:24.992538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:24.993163 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:24.999508 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:25.000026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:25.000857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:25.001381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:25.179458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:25.187959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:25.189441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:25.190627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cb15ae87-ae72-4104-922c-0a30fab13fb7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1600 microversion: 2.20 time: 0.202798 Aug 01 17:03:25.191184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 366/742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:03:24 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1600 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:03:25.214206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:25.214712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:25.221089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:25.221534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:25.222415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:25.222846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:25.308092 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a07828d3-ba71-4c50-b6be-0aae33ee9961 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097735 Aug 01 17:03:25.308683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 377/743] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 1 17:03:25 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 17:03:26.342712 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7d432768-97de-4382-83c1-1c7aa3dbcd74 req-d80ed23c-015d-49ca-a7dc-42780a439981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:26.354573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7d432768-97de-4382-83c1-1c7aa3dbcd74 req-d80ed23c-015d-49ca-a7dc-42780a439981 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:26.355462 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7d432768-97de-4382-83c1-1c7aa3dbcd74 req-d80ed23c-015d-49ca-a7dc-42780a439981 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:26.368879 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7d432768-97de-4382-83c1-1c7aa3dbcd74 req-d80ed23c-015d-49ca-a7dc-42780a439981 service nova] Creating event network-changed:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:03:26.374743 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7d432768-97de-4382-83c1-1c7aa3dbcd74 req-d80ed23c-015d-49ca-a7dc-42780a439981 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035650 Aug 01 17:03:26.376142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 367/744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:26.716629 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:26.717275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:26.731953 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:26.732712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:26.733851 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:26.734490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:26.778860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lazy-loading 'flavor' on Instance uuid 98630e53-1572-4ebc-9c74-3050a9ff16a3 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:27.037969 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-70ef909e-f16d-4e8f-a4a5-8b80c91b06ad tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "POST /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3/action" status: 202 len: 0 microversion: 2.1 time: 0.323597 Aug 01 17:03:27.038878 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 378/745] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:03:26 2022] POST /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:27.048951 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:27.049661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:27.058635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:27.063720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:27.063720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:27.063720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:27.227302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:27.236654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-145598cd-0b4d-4cc5-98a6-73abf717427a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.190931 Aug 01 17:03:27.238688 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 368/746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:27 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:28.261847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:28.262800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:28.269013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:28.269465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:28.270258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:28.271196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:28.488624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:28.497157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0a2bf36e-6874-4b82-abbc-e6338d50c560 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.240252 Aug 01 17:03:28.497727 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 379/747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:28 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:29.519030 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:29.519653 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:29.522871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:29.527713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:29.528173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:29.528941 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:29.529379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:29.819173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:29.827259 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0b2f72e6-7468-4f50-a0dd-69f6d51991d6 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.312064 Aug 01 17:03:29.827936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 369/748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:29 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:30.848730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:30.849892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:30.852347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:30.857327 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:30.857806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:30.858785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:30.859226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:31.052870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:31.060539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-79c5b6da-cb6b-4e26-9e74-7ecdc16ba863 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.215635 Aug 01 17:03:31.061105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 380/749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:30 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:32.082382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:32.083001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:32.090093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.090562 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.091315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.091756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.232393 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:32.240771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1ec52437-1681-4cbe-824c-edff5cf1a180 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.161498 Aug 01 17:03:32.241301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 370/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:32 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:32.505309 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:32.505861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:32.512449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.512887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.513718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.514177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.593846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'services' on Instance uuid 51b9e12b-2a9c-47d6-ad05-17f5030e3881 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:32.778643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-50cdb10e-18f9-4cca-b2af-63c42f3dc8a9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments/32b867cd-239b-4d83-ae22-0ee4910159e7" status: 202 len: 0 microversion: 2.1 time: 0.277442 Aug 01 17:03:32.779245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 381/751] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:03:32 2022] DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments/32b867cd-239b-4d83-ae22-0ee4910159e7 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:32.788209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:32.790387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:32.796366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.796806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.797564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:32.797992 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:32.826469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de21d0ca-3b4f-443b-a4cc-1f6e41c78d0c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042745 Aug 01 17:03:32.827019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 371/752] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:32 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:33.263328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:33.265516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:33.273031 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:33.273534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:33.274402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:33.274830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:33.421521 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:33.429891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-63ed8046-9667-4fc9-aa84-65c711aa572e tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.170988 Aug 01 17:03:33.430495 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 382/753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:33 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:33.839515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:33.841751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:33.848411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:33.849053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:33.849663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:33.850128 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:33.881099 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-11a1793b-29f9-4a6d-9043-5e2131dfdf74 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Aug 01 17:03:33.881670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 372/754] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:33 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:34.451591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:34.452207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:34.458822 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:34.459285 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:34.460068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:34.460502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:34.592162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:34.600210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-63b9327d-debd-4019-8f09-a03c09a48369 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.152390 Aug 01 17:03:34.600776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 383/755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:34 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:34.892922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:34.895248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:34.902424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:34.902874 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:34.903644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:34.904074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:34.933839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fb5fbc70-f4e8-4fba-a612-2d7531daa227 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044721 Aug 01 17:03:34.934419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 373/756] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:34 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:03:35.012230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:35.012728 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:35.018792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.022511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.022511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.022511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.045077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:35.059384 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:35.327298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a9920adf-8aed-4af1-baaf-11ba88231184 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 204 len: 0 microversion: 2.1 time: 0.318673 Aug 01 17:03:35.327892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 384/757] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:03:35 2022] DELETE /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:03:35.336819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:35.337401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:35.343540 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.343993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.344755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.345194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.476924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:35.484494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b0629e16-a0f1-4fb6-9767-2eb57a2b32b1 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1687 microversion: 2.1 time: 0.152466 Aug 01 17:03:35.485093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 374/758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:35 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:35.621534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:35.622274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:35.628879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.629360 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.630229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:35.630676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:35.762015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:35.770016 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-243261f0-1e28-4420-8513-c5391d97095f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.152702 Aug 01 17:03:35.772546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 385/759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:35 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:36.507406 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:36.508054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:36.514535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:36.514987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:36.515750 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:36.516190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:36.646495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:36.653916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-26a1fa1d-b793-4b84-830d-144133348656 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1687 microversion: 2.1 time: 0.151196 Aug 01 17:03:36.654500 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 375/760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:36 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:36.792613 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:36.793225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:36.799385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:36.799842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:36.800634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:36.801070 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:36.938015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:36.946177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c31787bc-d50a-45dd-a665-a4f7f7707947 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.157453 Aug 01 17:03:36.946752 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 386/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:36 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:37.675410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:37.676678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:37.684219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:37.684666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:37.685441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:37.685939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:37.971037 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:37.971627 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:37.978460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:37.978913 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:37.979901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:37.980340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:38.047301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:38.055685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ce0523c8-93d3-4606-9d1a-2faff41d1b91 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1687 microversion: 2.1 time: 0.384299 Aug 01 17:03:38.056261 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 376/762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:37 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1687 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:38.177957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:38.185524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e25345d8-7997-4b23-9b6a-222335d08288 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.219243 Aug 01 17:03:38.186110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 387/763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:37 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:39.077289 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:39.077908 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:39.084341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.084795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.085638 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.086132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.176531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:39.186077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-09484db2-59ef-45c9-9a11-167493ffbe8b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1621 microversion: 2.1 time: 0.112608 Aug 01 17:03:39.186824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 377/764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:39 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1621 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:39.188273 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-16091c3c-4f05-4f06-8245-5f32c111e7ff req-39db3f3d-1745-4bfd-a83d-3577327d5774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b9e12b-2a9c-47d6-ad05-17f5030e3881", "name": "network-vif-deleted", "tag": "dc404075-6194-4cfd-a993-456906d19d1d"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:39.198806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-16091c3c-4f05-4f06-8245-5f32c111e7ff req-39db3f3d-1745-4bfd-a83d-3577327d5774 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.199248 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-16091c3c-4f05-4f06-8245-5f32c111e7ff req-39db3f3d-1745-4bfd-a83d-3577327d5774 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.206420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:39.207188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:39.210978 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-16091c3c-4f05-4f06-8245-5f32c111e7ff req-39db3f3d-1745-4bfd-a83d-3577327d5774 service nova] Creating event network-vif-deleted:dc404075-6194-4cfd-a993-456906d19d1d for instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 on hv-cinder-84989 Aug 01 17:03:39.213660 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.214677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.215980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.216636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-16091c3c-4f05-4f06-8245-5f32c111e7ff req-39db3f3d-1745-4bfd-a83d-3577327d5774 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Aug 01 17:03:39.216772 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.217956 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 388/765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:39.368834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:39.376734 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a5a5453f-27d0-4af5-a824-d5b5790940f3 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.174057 Aug 01 17:03:39.377505 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 378/766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:39 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:39.605372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:39.607990 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:39.614161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.615231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.616400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.616871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.648002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6c8b0dcd-e50e-4bf4-88f4-05fa361f22a6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046817 Aug 01 17:03:39.648579 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 389/767] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:03:39 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:03:39.730283 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:39.730812 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:39.737422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.737874 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.738709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:39.739152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:39.769035 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:39.797424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:40.025609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a4575705-f85b-4107-b3e7-08f68e5d74b2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 204 len: 0 microversion: 2.1 time: 0.299101 Aug 01 17:03:40.030892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 379/768] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:03:39 2022] DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:03:40.034421 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:40.035077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:40.042144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.042744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.043536 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.044171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.185818 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:40.193725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-368e4bb1-61ef-47f4-b2f3-2fe0931e9823 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1674 microversion: 2.1 time: 0.163049 Aug 01 17:03:40.202126 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 390/769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:40 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:40.214025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:40.214758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:40.221379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.221861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.222688 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.223123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.258003 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.258576 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.259033 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 51b9e12b-2a9c-47d6-ad05-17f5030e3881 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:40.305388 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:40.311220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fb3122ef-01fb-420a-9a02-d96721f794ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1335 microversion: 2.1 time: 0.101656 Aug 01 17:03:40.311790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 380/770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:40 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:40.401267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:40.401267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:40.406293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.406740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.407492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.407926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.536725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:40.544605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9713e24c-5884-4bf4-acab-eb7c5511f562 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.149781 Aug 01 17:03:40.545175 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 391/771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:40 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:40.637336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b053fd96-3a40-4f56-a259-2e76c4b0dbbc req-c32d936e-3728-472c-9939-4061809ba666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "name": "network-vif-unplugged", "status": "completed", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:40.647359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b053fd96-3a40-4f56-a259-2e76c4b0dbbc req-c32d936e-3728-472c-9939-4061809ba666 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:40.647810 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b053fd96-3a40-4f56-a259-2e76c4b0dbbc req-c32d936e-3728-472c-9939-4061809ba666 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:40.657952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b053fd96-3a40-4f56-a259-2e76c4b0dbbc req-c32d936e-3728-472c-9939-4061809ba666 service nova] Creating event network-vif-unplugged:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:03:40.663434 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b053fd96-3a40-4f56-a259-2e76c4b0dbbc req-c32d936e-3728-472c-9939-4061809ba666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029757 Aug 01 17:03:40.667606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 381/772] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:41.215168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:41.215690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:41.222349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.222806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.223607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.224555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.333653 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:41.334465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:41.340752 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.341207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.341985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.342437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.353891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:41.361411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e82593bb-3c92-4318-8f78-9ed97e929c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1674 microversion: 2.1 time: 0.150203 Aug 01 17:03:41.363943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 392/773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:41 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:41.389320 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.389766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.390284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 51b9e12b-2a9c-47d6-ad05-17f5030e3881 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:41.438538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:41.446016 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c919dadf-a152-491c-940e-d6ec0ae983ef tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 200 len: 1335 microversion: 2.1 time: 0.117460 Aug 01 17:03:41.446620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 382/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:41 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:41.566371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:41.566975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:41.573896 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.574380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.575162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:41.575589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:41.727071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:41.735025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ba714680-df7b-4663-98c2-071f8893b9c2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.172426 Aug 01 17:03:41.735636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 393/775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:41 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:42.384615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:42.385370 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:42.391939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.392392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.393169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.393662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.467950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:42.469313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 51b9e12b-2a9c-47d6-ad05-17f5030e3881] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:42.477287 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.478704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.479226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.479725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.480444 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:42.489518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-393848b8-c75e-44da-9710-f7ef18219af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 200 len: 1606 microversion: 2.1 time: 0.109825 Aug 01 17:03:42.490606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 383/776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:42 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 1606 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:42.494814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] HTTP exception thrown: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Request method failure captured: Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 HTTP/1.1 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVuTp1cjRXSsjnVLuWdfKw2MyFRF9Yaa0YCWVsV5c5BXAzW7gUOYKqgzMSCEXKqdp_0KiE-3fH7MVYhZjQvjEcWcyeR_jaW8HyWJsuwU2waAIXkEDhn6_fIbISqqjH1T8SBmYaxHlmVD9DpLxlm-FEZqj-Mq_Mu3aiav6E_9FrtR14 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:03:42.496522 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64929e340dae4c0f90162702aab5bc21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b353fdd302394227987a6ae8c2943173 Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. Aug 01 17:03:42.498061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '51b9e12b-2a9c-47d6-ad05-17f5030e3881'} Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:42.498873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. Aug 01 17:03:42.500240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:42.501385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Returning 404 to user: Instance 51b9e12b-2a9c-47d6-ad05-17f5030e3881 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:42.501385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9a40fbab-d4e3-4f1c-be70-e2e2865a88d4 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881" status: 404 len: 111 microversion: 2.1 time: 0.035233 Aug 01 17:03:42.502560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 394/777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:42 2022] GET /compute/v2.1/servers/51b9e12b-2a9c-47d6-ad05-17f5030e3881 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:03:42.507807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-421359b1-aadf-4255-9bd5-a284367ffa9f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '.version_select at 0x7f733d9caf70>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:42.513395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-0baecc43-5c80-449a-a90e-6e81514643da req-39142436-9df3-48cd-914a-bc8af6a89b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac7cea8-b1f2-4104-bb3b-083dcacbf502", "name": "network-vif-deleted", "tag": "e12e7e64-d495-4d63-b74b-0480b5df984e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:42.524457 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0baecc43-5c80-449a-a90e-6e81514643da req-39142436-9df3-48cd-914a-bc8af6a89b57 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.524818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0baecc43-5c80-449a-a90e-6e81514643da req-39142436-9df3-48cd-914a-bc8af6a89b57 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.549276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-0baecc43-5c80-449a-a90e-6e81514643da req-39142436-9df3-48cd-914a-bc8af6a89b57 service nova] Creating event network-vif-deleted:e12e7e64-d495-4d63-b74b-0480b5df984e for instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 on hv-cinder-84989 Aug 01 17:03:42.549276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-0baecc43-5c80-449a-a90e-6e81514643da req-39142436-9df3-48cd-914a-bc8af6a89b57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Aug 01 17:03:42.550573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 384/778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:42.603641 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-421359b1-aadf-4255-9bd5-a284367ffa9f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144750340" status: 202 len: 0 microversion: 2.1 time: 0.099924 Aug 01 17:03:42.607314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 395/779] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 1 17:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144750340 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:42.758053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:42.758930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:42.765442 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.766179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.767139 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.767578 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.932604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:42.941174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a3d3028b-6217-4430-b29a-7416d03200db tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1510 microversion: 2.1 time: 0.188005 Aug 01 17:03:42.953918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 385/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:42 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:42.968673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:42.969488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:42.977018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.985126 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:42.985126 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:42.985126 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:43.008981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124835) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 17:03:43.279351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-88630d64-9c4f-4a6d-b9b7-70766124f1e8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "POST /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3/action" status: 202 len: 0 microversion: 2.1 time: 0.315052 Aug 01 17:03:43.280668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 396/781] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 1 17:03:42 2022] POST /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:43.295724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:43.297375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:43.311421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:43.311880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:43.312666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:43.313102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:43.512146 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:43.512793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:43.516185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:43.519375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:43.519833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:43.520667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:43.521277 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:43.530833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-22331d85-540c-4c37-a702-81b0d5d5e8df tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1518 microversion: 2.1 time: 0.239341 Aug 01 17:03:43.530833 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 386/782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:43 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1518 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:43.539884 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 HTTP/1.1 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:03:43.541528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:03:43.542910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'eac7cea8-b1f2-4104-bb3b-083dcacbf502'} Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:43.543957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:03:43.545167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:43.547260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:43.547260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b26be479-9db4-4751-9021-08afe9cd02b5 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 404 len: 111 microversion: 2.1 time: 0.034720 Aug 01 17:03:43.547260 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 397/783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:43 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:03:43.553689 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de266ea1-fd48-40e3-892a-8ffc601a97c6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '.version_select at 0x7f733d99b940>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:43.643229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de266ea1-fd48-40e3-892a-8ffc601a97c6 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529675577" status: 202 len: 0 microversion: 2.1 time: 0.091254 Aug 01 17:03:43.646254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 387/784] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 1 17:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529675577 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:03:44.550253 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:44.550871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:44.563373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:44.563823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:44.565124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:44.565564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:44.693585 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c5679bcc-3b85-4e1a-9794-c73fc6d17cf8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: .version_select at 0x7f733d97c310>, body: {"keypair": {"name": "tempest-keypair-853227624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdA3N3E3K6f80OmLG4zSqYmpnBT84urLWYiIc8aVRKqg9N+oPwOkW+PXtsePZ2bxPBxxzYkQu5BHCtSoic8wcGGLzBtMBMkJ8biTJyKdmuPMmY8s5/8VxerXUCxvgJEOg=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:44.711055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-c5679bcc-3b85-4e1a-9794-c73fc6d17cf8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:03:44.715043 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-c5679bcc-3b85-4e1a-9794-c73fc6d17cf8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for user c2079b0fbf7b4a8c88d2522da9f2c73b and project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:03:44.719601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:44.729455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cb14c114-8192-493c-bbb7-a2bb84cc1014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1520 microversion: 2.1 time: 0.183183 Aug 01 17:03:44.732316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 398/785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:44 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:44.808685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c5679bcc-3b85-4e1a-9794-c73fc6d17cf8 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120177 Aug 01 17:03:44.809294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 388/786] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:03:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:45.752967 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:45.753655 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:45.761350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:45.762192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:45.762672 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:45.763105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:45.918151 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:45.925608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e698fa15-4855-432b-8f1d-982954d0dca7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.176594 Aug 01 17:03:45.926191 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 399/787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:45 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:46.033909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:46.034494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:46.041133 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.041891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:46.045314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.045774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:46.076444 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:46.373375 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-38482303-2060-48b5-8293-7f494989399c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 204 len: 0 microversion: 2.1 time: 0.343601 Aug 01 17:03:46.374416 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 389/788] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:03:46 2022] DELETE /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:03:46.383438 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:46.386290 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:46.390582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.391688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:46.392768 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.393559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:46.599058 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:46.607279 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e0902ff9-19b5-4dad-8c2f-b31dd5b47ee0 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1508 microversion: 2.1 time: 0.228790 Aug 01 17:03:46.607849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 400/789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:46 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:46.947680 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:46.948539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:46.955243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.955814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:46.956822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:46.957357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:47.094025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:47.102248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5bcd4d6b-16f0-412e-833c-c4c236bc0718 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.159472 Aug 01 17:03:47.102818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 390/790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:46 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:47.191552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-753111848", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b45f120b-a0dc-4da7-8661-b8d262f22721"}], "security_groups": [{"name": "tempest-securitygroup--1671796846"}], "key_name": "tempest-keypair-853227624", "user_data": "}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:47.296501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] validate_networks() for [('b45f120b-a0dc-4da7-8661-b8d262f22721', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:03:47.629223 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:47.629839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:47.636573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:47.637021 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:47.637784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:47.638245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:47.661677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:03:47.662129 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:03:47.663295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:03:47.663889 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:03:47.664313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:03:47.673352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:47.673801 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:47.674858 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:47.675300 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:47.693211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:03:47.697387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Getting quotas for user c2079b0fbf7b4a8c88d2522da9f2c73b and project ee3d55c8b96e4821bd2592a3ee665533. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:03:47.711140 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:03:47.713463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:03:47.770905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:47.778881 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3627d008-6b43-4cd3-83ae-447747654add tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1508 microversion: 2.1 time: 0.153643 Aug 01 17:03:47.779451 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 391/791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:47 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:47.867135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-101438c3-3f64-4d48-ad72-f2e16f5b4309 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679728 Aug 01 17:03:47.868249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 401/792] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:03:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:03:47.878934 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6713ed6a-b971-44c6-94ae-cf465fc26809 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:47.879546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6713ed6a-b971-44c6-94ae-cf465fc26809 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:47.949061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6713ed6a-b971-44c6-94ae-cf465fc26809 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:47.955851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6713ed6a-b971-44c6-94ae-cf465fc26809 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1236 microversion: 2.1 time: 0.080718 Aug 01 17:03:47.956429 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 392/793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:47 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:48.127755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:48.128361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:48.135863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.136339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.137098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.137529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.276368 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:48.279940 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:48.284255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-87a3f4b5-55ea-46c5-ac30-f4b34f99ad3f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.160715 Aug 01 17:03:48.284825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 402/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:48 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:48.800482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:48.801122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:48.808551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.809004 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.809758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.810232 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.976846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:48.977763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:48.978399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:48.984998 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.985448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.985951 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a30e952a-f297-4905-a4f6-8c494fd84d25 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1508 microversion: 2.1 time: 0.189235 Aug 01 17:03:48.986398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:48.992356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:48.995001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 393/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:48 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:49.054846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:49.062061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-96bf9a55-1a13-4109-a954-d5b741895288 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1240 microversion: 2.1 time: 0.089140 Aug 01 17:03:49.062693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 403/796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:48 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:49.307526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:49.308235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:49.315744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:49.316318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:49.320130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:49.320130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:49.385600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-ffeb1ff9-e40c-4b75-a831-6d4aa4bf9e04 req-7a59ef3e-1bf3-42a8-8ed4-642e720bf366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0921a70d-6912-4400-858b-2af63cf43e11", "name": "network-vif-deleted", "tag": "f74d95b4-ded1-42a4-8000-2ae76b64e736"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:49.396478 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-ffeb1ff9-e40c-4b75-a831-6d4aa4bf9e04 req-7a59ef3e-1bf3-42a8-8ed4-642e720bf366 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:49.397241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-ffeb1ff9-e40c-4b75-a831-6d4aa4bf9e04 req-7a59ef3e-1bf3-42a8-8ed4-642e720bf366 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:49.410428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-ffeb1ff9-e40c-4b75-a831-6d4aa4bf9e04 req-7a59ef3e-1bf3-42a8-8ed4-642e720bf366 service nova] Creating event network-vif-deleted:f74d95b4-ded1-42a4-8000-2ae76b64e736 for instance 0921a70d-6912-4400-858b-2af63cf43e11 on hv-cinder-84989 Aug 01 17:03:49.416928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-ffeb1ff9-e40c-4b75-a831-6d4aa4bf9e04 req-7a59ef3e-1bf3-42a8-8ed4-642e720bf366 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Aug 01 17:03:49.417599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 404/797] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:03:49.501337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:49.509389 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ceb76eb-dafa-4477-8dec-1fcc7c17863f tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.207721 Aug 01 17:03:49.509952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 394/798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:49 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:50.010101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:50.010761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:50.017373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.017819 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.018620 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.019316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.052147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.052596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.053580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 0921a70d-6912-4400-858b-2af63cf43e11 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:50.083018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:50.083634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:50.090398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.090852 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.091625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.092062 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.095286 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:50.103382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dedabea4-1650-4828-a44e-3ae788d8b0ad tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 200 len: 1312 microversion: 2.1 time: 0.098348 Aug 01 17:03:50.103961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 405/799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:50 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:50.156727 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:50.164738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ea9c7b0a-9e4b-483d-9708-e8efe38f9af9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1296 microversion: 2.1 time: 0.085642 Aug 01 17:03:50.165301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 395/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:50 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:50.535374 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:50.536182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:50.545245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.545878 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.546931 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:50.547426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:50.701331 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:50.710463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e32cd5d4-ff57-420d-8339-878b89de07f7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.182179 Aug 01 17:03:50.722088 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 406/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:50 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:51.128850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:51.129463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 0921a70d-6912-4400-858b-2af63cf43e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:51.136657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.137166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.137972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.138459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] HTTP exception thrown: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Request method failure captured: Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 HTTP/1.1 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVuTp1cjRXSsjnVLuWdfKw2MyFRF9Yaa0YCWVsV5c5BXAzW7gUOYKqgzMSCEXKqdp_0KiE-3fH7MVYhZjQvjEcWcyeR_jaW8HyWJsuwU2waAIXkEDhn6_fIbISqqjH1T8SBmYaxHlmVD9DpLxlm-FEZqj-Mq_Mu3aiav6E_9FrtR14 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:03:51.155993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64929e340dae4c0f90162702aab5bc21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: b353fdd302394227987a6ae8c2943173 Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. Aug 01 17:03:51.158737 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '0921a70d-6912-4400-858b-2af63cf43e11'} Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:51.159960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. Aug 01 17:03:51.161476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:03:51.163239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Returning 404 to user: Instance 0921a70d-6912-4400-858b-2af63cf43e11 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:51.163239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a38bd506-59d9-49e5-a332-aa322348cca9 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11" status: 404 len: 111 microversion: 2.1 time: 0.030979 Aug 01 17:03:51.163239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 396/802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:51 2022] GET /compute/v2.1/servers/0921a70d-6912-4400-858b-2af63cf43e11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:03:51.164886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:51.165419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:51.171827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.172379 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.173233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.173821 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.185619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:51.186270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:51.192736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.193180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.194662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.199497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.219524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:03:51.399924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:51.408808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1e9eeb93-9140-4f13-bd36-789651c59208 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.227113 Aug 01 17:03:51.409460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 397/803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:51 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:51.498741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-828f351f-2c6a-4ed6-9dfd-410dbef13913 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 204 len: 0 microversion: 2.1 time: 0.337690 Aug 01 17:03:51.499518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 407/804] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:03:51 2022] DELETE /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:03:51.508149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:51.508759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:51.515052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.515493 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.516436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.516880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.521156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:51.727681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:51.732873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:51.734283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:51.735251 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-07b43076-1da0-41fe-bcdb-54dc2a359e3f tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1523 microversion: 2.1 time: 0.231532 Aug 01 17:03:51.735862 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 398/805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:51 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:51.741588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.742624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.743479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:51.743992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:51.880253 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:51.888599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3c6caaf8-3558-4c23-a3f3-6361c0f53e8a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.160008 Aug 01 17:03:51.889172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 408/806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:51 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:52.150749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-3c9a362c-7b00-4137-9516-f34362c1231b req-e87db91f-6e3d-4d86-b9d5-0dd82c21b17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb11ea4-ac85-43d4-a159-9c03a59c6827", "tag": "ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:52.160413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3c9a362c-7b00-4137-9516-f34362c1231b req-e87db91f-6e3d-4d86-b9d5-0dd82c21b17b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.160870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3c9a362c-7b00-4137-9516-f34362c1231b req-e87db91f-6e3d-4d86-b9d5-0dd82c21b17b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.171981 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-3c9a362c-7b00-4137-9516-f34362c1231b req-e87db91f-6e3d-4d86-b9d5-0dd82c21b17b service nova] Creating event network-changed:ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f for instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 on hv-cinder-84989 Aug 01 17:03:52.177714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-3c9a362c-7b00-4137-9516-f34362c1231b req-e87db91f-6e3d-4d86-b9d5-0dd82c21b17b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Aug 01 17:03:52.177714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 399/807] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:52.432185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:52.432800 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:52.440034 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.440609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.441520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.442079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.637841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:52.645850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6c68f706-2512-4a26-b720-faf484091c33 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.218869 Aug 01 17:03:52.646564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 409/808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:52 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:52.724456 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-43c461b0-73ec-4bcf-b34e-1a4eb27e479c req-7cf366c7-d14a-4a99-845e-8a8fe52a51a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "name": "network-vif-plugged", "status": "completed", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:52.735120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-43c461b0-73ec-4bcf-b34e-1a4eb27e479c req-7cf366c7-d14a-4a99-845e-8a8fe52a51a3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.736792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-43c461b0-73ec-4bcf-b34e-1a4eb27e479c req-7cf366c7-d14a-4a99-845e-8a8fe52a51a3 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.747244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-43c461b0-73ec-4bcf-b34e-1a4eb27e479c req-7cf366c7-d14a-4a99-845e-8a8fe52a51a3 service nova] Creating event network-vif-plugged:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:03:52.752314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-43c461b0-73ec-4bcf-b34e-1a4eb27e479c req-7cf366c7-d14a-4a99-845e-8a8fe52a51a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Aug 01 17:03:52.753053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 400/809] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:52.759146 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:52.759941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:52.767888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.768339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.769110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.769543 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.840350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:52.848621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-af3f1814-260a-41ab-a944-80b192690c06 tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1481 microversion: 2.1 time: 0.095421 Aug 01 17:03:52.851135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 410/810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:52 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1481 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:52.911761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:52.913125 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:52.922766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.923674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:52.924482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:52.924973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.107633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:53.115663 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ebb2749a-1222-4e29-a026-4e6655827ef9 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.209122 Aug 01 17:03:53.123359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 401/811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:52 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:53.667683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:53.668301 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:53.671414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:53.674853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:53.675306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.676072 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:53.676512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.810784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:53.818025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-de66de7e-8724-4ac2-bac8-00cef0a66014 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.154257 Aug 01 17:03:53.819229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 411/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:53 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:53.870853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:53.871469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:53.877985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:53.878451 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.879220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:53.879666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.910471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:53.910925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:53.911382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 27932a15-1227-4a4d-9d0a-11f8acddde3d {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:53.953012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:53.960487 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b5c65b41-ca24-4550-986e-9e8522614f0b tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1312 microversion: 2.1 time: 0.093564 Aug 01 17:03:53.961049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 402/813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:53 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:54.136838 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:54.137443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:54.143531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.145881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.145881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.145881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.192758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-6cd7a4dc-3dbf-46fe-9311-60104c35e294 req-d383df40-5903-45eb-872e-51d9edc501cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27932a15-1227-4a4d-9d0a-11f8acddde3d", "name": "network-vif-deleted", "tag": "e5d91718-9dfb-4cfd-8f3b-edc873c093f3"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:54.197657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:54.207116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6cd7a4dc-3dbf-46fe-9311-60104c35e294 req-d383df40-5903-45eb-872e-51d9edc501cb service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.207116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6cd7a4dc-3dbf-46fe-9311-60104c35e294 req-d383df40-5903-45eb-872e-51d9edc501cb service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.214245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-6cd7a4dc-3dbf-46fe-9311-60104c35e294 req-d383df40-5903-45eb-872e-51d9edc501cb service nova] Creating event network-vif-deleted:e5d91718-9dfb-4cfd-8f3b-edc873c093f3 for instance 27932a15-1227-4a4d-9d0a-11f8acddde3d on hv-cinder-84989 Aug 01 17:03:54.218962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-6cd7a4dc-3dbf-46fe-9311-60104c35e294 req-d383df40-5903-45eb-872e-51d9edc501cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029832 Aug 01 17:03:54.219549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 403/814] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:54.276357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:54.284518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-eb422b05-af74-4a12-a025-c8ae0fbea2be tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.151507 Aug 01 17:03:54.285151 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 412/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:54 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:54.840972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:54.841584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:54.847794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.848235 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.848983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.849417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.981076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:54.981602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:54.983494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:54.988174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.988625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.989546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:54.989989 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:54.992106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-79f315bc-6264-41d9-8a09-68a5613b5ad4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.155767 Aug 01 17:03:54.992758 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 404/816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:54 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:55.023621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:55.024062 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:55.024535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 27932a15-1227-4a4d-9d0a-11f8acddde3d {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:55.070133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:55.077565 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9650d48e-bcbe-4e5c-a165-16ce96ceec4c tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1312 microversion: 2.1 time: 0.100615 Aug 01 17:03:55.078150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 413/817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:54 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:55.307911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:55.308574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:55.314676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:55.315117 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:55.315873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:55.316306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:55.447493 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:55.454406 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b087b58e-45b3-4d68-a443-65972ff126b0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.151466 Aug 01 17:03:55.454973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 405/818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:55 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:56.012859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:56.013502 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:56.020059 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.020517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.021303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.021861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.098344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:56.098997 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:56.106427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.106882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.107662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.108101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.142282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.142732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.143183 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lazy-loading 'fault' on Instance uuid 27932a15-1227-4a4d-9d0a-11f8acddde3d {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:03:56.153794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:56.161402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-00ef09df-275a-4094-b52d-0bc9385eea43 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.152340 Aug 01 17:03:56.161944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 414/819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:56 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:56.187367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b353fdd302394227987a6ae8c2943173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64929e340dae4c0f90162702aab5bc21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:56.195312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-856d61ce-3846-424c-81b2-d448bc0895ba tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 200 len: 1312 microversion: 2.1 time: 0.100960 Aug 01 17:03:56.195871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 406/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:56 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:56.475338 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:56.476045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:56.482338 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.482780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.483557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:56.483993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:56.624597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:56.633927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7028fb3d-d417-4f7d-9357-01b6e167b5e0 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1576 microversion: 2.1 time: 0.162251 Aug 01 17:03:56.647939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 415/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:56 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:03:57.183263 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:57.188052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:57.190402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.190858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.191619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.192057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.216470 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:57.217390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] [instance: 27932a15-1227-4a4d-9d0a-11f8acddde3d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:57.224292 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.225388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.226284 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.226794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.243298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] HTTP exception thrown: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Request method failure captured: Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d HTTP/1.1 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVuTp1cjRXSsjnVLuWdfKw2MyFRF9Yaa0YCWVsV5c5BXAzW7gUOYKqgzMSCEXKqdp_0KiE-3fH7MVYhZjQvjEcWcyeR_jaW8HyWJsuwU2waAIXkEDhn6_fIbISqqjH1T8SBmYaxHlmVD9DpLxlm-FEZqj-Mq_Mu3aiav6E_9FrtR14 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:03:57.245455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64929e340dae4c0f90162702aab5bc21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64929e340dae4c0f90162702aab5bc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 64929e340dae4c0f90162702aab5bc21 Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1004592944 Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b353fdd302394227987a6ae8c2943173 Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1004592944-project Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. Aug 01 17:03:57.247110 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '27932a15-1227-4a4d-9d0a-11f8acddde3d'} Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:03:57.248003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. Aug 01 17:03:57.249538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:03:57.256904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] Returning 404 to user: Instance 27932a15-1227-4a4d-9d0a-11f8acddde3d could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:03:57.256904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f2816365-e254-4871-b1da-67c55d43a99d tempest-ServerRescueNegativeTestJSON-1004592944 tempest-ServerRescueNegativeTestJSON-1004592944-project] 10.222.0.20 "GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d" status: 404 len: 111 microversion: 2.1 time: 0.036395 Aug 01 17:03:57.256904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 416/822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:57 2022] GET /compute/v2.1/servers/27932a15-1227-4a4d-9d0a-11f8acddde3d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:03:57.357420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:57.366799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3b3a1282-8dcf-4add-b94c-8171ea66a02e tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.187421 Aug 01 17:03:57.367885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 407/823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:57 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:57.654812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:57.655322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:57.661412 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.661860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.662802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:57.663280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:57.684477 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:57.705207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:57.885243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:57.892859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-acfbbbf1-4e8d-4256-9412-e0131b72f9ac tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1563 microversion: 2.1 time: 0.242031 Aug 01 17:03:57.893437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 417/824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:57 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:58.387839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:58.388454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:58.390503 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:58.395699 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:58.396147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:58.397054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:58.397495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:58.542817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:58.551004 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7febea33-8716-44af-9b12-773a70dad0fe tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.166990 Aug 01 17:03:58.551685 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 408/825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:58 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:03:58.792341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-98c70b94-2ece-48ed-b075-d1b0aa047d1d req-680ab731-42b4-4a55-96d5-5cb5f6eae7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb11ea4-ac85-43d4-a159-9c03a59c6827", "name": "network-vif-plugged", "status": "completed", "tag": "ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:03:58.803638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-98c70b94-2ece-48ed-b075-d1b0aa047d1d req-680ab731-42b4-4a55-96d5-5cb5f6eae7fa service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:58.804081 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-98c70b94-2ece-48ed-b075-d1b0aa047d1d req-680ab731-42b4-4a55-96d5-5cb5f6eae7fa service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:58.815170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-98c70b94-2ece-48ed-b075-d1b0aa047d1d req-680ab731-42b4-4a55-96d5-5cb5f6eae7fa service nova] Creating event network-vif-plugged:ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f for instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 on hv-cinder-84989 Aug 01 17:03:58.820581 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-98c70b94-2ece-48ed-b075-d1b0aa047d1d req-680ab731-42b4-4a55-96d5-5cb5f6eae7fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Aug 01 17:03:58.821378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 418/826] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:03:59.574064 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:03:59.575630 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:03:59.580976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:59.581665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:59.582468 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:03:59.582903 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:03:59.722476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:03:59.730286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-77b9a6fd-74cc-415a-9893-6b257f4a9006 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.159802 Aug 01 17:03:59.730633 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 409/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:03:59 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:00.754970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:00.756786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:00.764182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:00.764921 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:00.765742 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:00.766244 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:00.770930 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:00.934983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:00.942738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5612fa3a-2535-4aeb-985b-94b20fb87822 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1362 microversion: 2.1 time: 0.193909 Aug 01 17:04:00.943308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 419/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:00 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:01.964623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:01.965240 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:01.972144 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:01.972593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:01.973357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:01.973793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:02.108736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:02.117594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-70e578df-1943-457e-a8e3-7566b2a8949d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1548 microversion: 2.1 time: 0.156749 Aug 01 17:04:02.118194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 410/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:01 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:02.139291 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:02.139788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:02.147747 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:02.148323 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:02.149107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:02.149550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:02.227744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e3dcaa52-3020-49dc-a165-9bce4047d384 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092189 Aug 01 17:04:02.228341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 420/830] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:04:02 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:04:03.229969 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-52fb4500-5da0-410a-97f8-74ff9f626ea0 req-10625c6e-8ecf-48a4-bcd0-84efac83a03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb11ea4-ac85-43d4-a159-9c03a59c6827", "tag": "ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:03.241130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-52fb4500-5da0-410a-97f8-74ff9f626ea0 req-10625c6e-8ecf-48a4-bcd0-84efac83a03e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:03.241572 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-52fb4500-5da0-410a-97f8-74ff9f626ea0 req-10625c6e-8ecf-48a4-bcd0-84efac83a03e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:03.255250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-52fb4500-5da0-410a-97f8-74ff9f626ea0 req-10625c6e-8ecf-48a4-bcd0-84efac83a03e service nova] Creating event network-changed:ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f for instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 on hv-cinder-84989 Aug 01 17:04:03.265079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-52fb4500-5da0-410a-97f8-74ff9f626ea0 req-10625c6e-8ecf-48a4-bcd0-84efac83a03e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035337 Aug 01 17:04:03.265079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 411/831] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:04:08.561859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0cc03cf0-1430-45af-8db2-bac42f8db804 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: .version_select at 0x7f733d96f5e0>, body: {"keypair": {"name": "tempest-keypair-685272777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4k8fBPH3NtOhQUtABL5rQQn4QgGYUu8LnWh21ItcEIQx3Rv02yAfqwursXPPEM1836mnOi2e4O91w+3F79cjPQ3mHr+ege8u6V5JxUlVC6iV3RpLh6aAdEwS2Gn5PWhw=="}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:08.578571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-0cc03cf0-1430-45af-8db2-bac42f8db804 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:04:08.582542 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-0cc03cf0-1430-45af-8db2-bac42f8db804 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:04:08.711216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0cc03cf0-1430-45af-8db2-bac42f8db804 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267508 Aug 01 17:04:08.711853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 421/832] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:04:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:04:10.812629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1143654878", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ade5d3a-dad9-4932-9ac9-db242643b6f5"}], "security_groups": [{"name": "tempest-securitygroup--1916128455"}], "key_name": "tempest-keypair-685272777", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:10.922582 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] validate_networks() for [('6ade5d3a-dad9-4932-9ac9-db242643b6f5', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:04:11.367437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:04:11.367946 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:04:11.368488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:04:11.368960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:04:11.369670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:04:11.379226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:11.379674 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:11.380467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:11.381489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:11.400327 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:04:11.405122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:04:11.417584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:04:11.420169 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:04:11.543168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a164bc8b-9955-4cba-85e2-e6cdb9ed74f7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.735025 Aug 01 17:04:11.544065 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 412/833] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:04:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:04:11.558557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-51860617-339e-44f4-93f6-1fd4c0cec092 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:11.566221 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-51860617-339e-44f4-93f6-1fd4c0cec092 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:11.634387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-51860617-339e-44f4-93f6-1fd4c0cec092 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:11.642947 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-51860617-339e-44f4-93f6-1fd4c0cec092 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1241 microversion: 2.1 time: 0.091299 Aug 01 17:04:11.643525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 422/834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:11 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:12.666756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:12.667738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:12.679011 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:12.679525 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:12.680654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:12.681333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:12.750176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:12.757818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-67a1d2f5-f666-4bb6-9d5b-8357be39ef0c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1245 microversion: 2.1 time: 0.097562 Aug 01 17:04:12.758413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 413/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:12 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:13.778539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:13.779305 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:13.780986 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=8 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:13.786352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:13.786798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:13.788319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:13.788787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:13.854933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:13.866683 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6b929d45-ac17-448a-9d47-96f71b5656e3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1301 microversion: 2.1 time: 0.090423 Aug 01 17:04:13.873593 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 423/836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:13 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:14.887925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:14.888496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:14.895060 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:14.895512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:14.896387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:14.901159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:15.101623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:15.109170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-538edfd2-44cd-46ce-a72f-40574512b673 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.225235 Aug 01 17:04:15.109740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 414/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:14 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:15.548695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-89614858-9735-4535-ab32-d554042856d7 req-f6bcd6a7-6228-4fd8-a7d1-39d05ac412b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51df7577-f191-4c2b-aaf4-d69c0d759f28", "tag": "1f6310e3-403c-4493-a502-419db6a0cd7b"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:15.558532 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-89614858-9735-4535-ab32-d554042856d7 req-f6bcd6a7-6228-4fd8-a7d1-39d05ac412b6 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:15.558957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-89614858-9735-4535-ab32-d554042856d7 req-f6bcd6a7-6228-4fd8-a7d1-39d05ac412b6 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:15.569949 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-89614858-9735-4535-ab32-d554042856d7 req-f6bcd6a7-6228-4fd8-a7d1-39d05ac412b6 service nova] Creating event network-changed:1f6310e3-403c-4493-a502-419db6a0cd7b for instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 on hv-cinder-84989 Aug 01 17:04:15.574873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-89614858-9735-4535-ab32-d554042856d7 req-f6bcd6a7-6228-4fd8-a7d1-39d05ac412b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030290 Aug 01 17:04:15.575457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 424/838] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:04:16.132366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:16.132919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:16.140025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:16.140473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:16.141245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:16.141675 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:16.383097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:16.390644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8e480f75-abe7-45bd-8593-a0eba7ae9251 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.263370 Aug 01 17:04:16.391229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 415/839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:16 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:17.411872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:17.413142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:17.419339 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:17.419782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:17.420529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:17.420962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:17.552904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:17.560264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dccfd7a8-70c5-4bee-9162-565c3fa21f5e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.153100 Aug 01 17:04:17.560835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 425/840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:17 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:04:18.580666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:18.581271 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:18.587890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:18.588338 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:18.589092 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:18.589526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:18.716846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:18.724295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6bf7dd94-0b83-4ce8-abab-60791d56b4a7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.147422 Aug 01 17:04:18.725026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 416/841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:18 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:19.745787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:19.746357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:19.752935 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:19.753387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:19.754186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:19.754661 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:19.883241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:19.890659 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-07a2c105-df99-4def-b62b-e1bbcb8ed6e4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.148822 Aug 01 17:04:19.904221 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 426/842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:19 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:20.924256 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:20.924881 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:20.931904 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:20.932355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:20.933182 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:20.933631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:20.952319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:21.073303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:21.080849 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bc3fa10a-fb9b-4f77-bd0f-49c8fb9b2653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.160566 Aug 01 17:04:21.081411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 417/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:20 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:22.102164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:22.102770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:22.105137 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:22.109905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:22.110369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:22.111121 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:22.111547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:22.239608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:22.254017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-42b0d874-aa1c-4902-a337-3de2233f60ef tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.150936 Aug 01 17:04:22.254017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 427/844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:22 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:22.866655 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-c73c7c16-f3ca-4b9d-b497-efe9400a4c02 req-28e507a6-e9b3-4598-aafa-bb4bc92ffed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51df7577-f191-4c2b-aaf4-d69c0d759f28", "name": "network-vif-plugged", "status": "completed", "tag": "1f6310e3-403c-4493-a502-419db6a0cd7b"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:22.871631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:22.872287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:22.877584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c73c7c16-f3ca-4b9d-b497-efe9400a4c02 req-28e507a6-e9b3-4598-aafa-bb4bc92ffed4 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:22.878062 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c73c7c16-f3ca-4b9d-b497-efe9400a4c02 req-28e507a6-e9b3-4598-aafa-bb4bc92ffed4 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:22.888869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-c73c7c16-f3ca-4b9d-b497-efe9400a4c02 req-28e507a6-e9b3-4598-aafa-bb4bc92ffed4 service nova] Creating event network-vif-plugged:1f6310e3-403c-4493-a502-419db6a0cd7b for instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 on hv-cinder-84989 Aug 01 17:04:22.893838 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-c73c7c16-f3ca-4b9d-b497-efe9400a4c02 req-28e507a6-e9b3-4598-aafa-bb4bc92ffed4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Aug 01 17:04:22.894504 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 418/845] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:04:23.270551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:23.271166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:23.278519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:23.278972 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:23.279731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:23.280166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:23.411846 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:23.419431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2bf69ddb-38be-4689-8bb4-d49857a184aa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.152733 Aug 01 17:04:23.420002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 428/846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:23 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:24.441893 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:24.442617 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:24.449341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:24.449790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:24.450577 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:24.451015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:24.581612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:24.589457 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-760e8507-fd46-4361-a11d-fc86d19e353f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1367 microversion: 2.1 time: 0.152943 Aug 01 17:04:24.590040 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 419/847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:24 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:25.610476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:25.611044 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:25.613423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:25.618507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:25.618942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:25.619705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:25.620145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:25.751287 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:25.759444 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ba9c10bd-0129-493d-9eb5-03b5b90c198e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1557 microversion: 2.1 time: 0.152991 Aug 01 17:04:25.760009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 429/848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:04:25 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:04:25.779790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:25.780316 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:25.782735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:25.787585 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:25.788038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:25.788811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:25.789330 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:25.870002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-07b98be4-2191-4975-a952-87644d599e2b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094030 Aug 01 17:04:25.870621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 420/849] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:04:25 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:04:26.841359 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-d44455a5-86ff-4cc1-9712-a4e8889247bb req-73c01404-d545-4466-b1f6-474c66bb2801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51df7577-f191-4c2b-aaf4-d69c0d759f28", "tag": "1f6310e3-403c-4493-a502-419db6a0cd7b"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:26.851744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-d44455a5-86ff-4cc1-9712-a4e8889247bb req-73c01404-d545-4466-b1f6-474c66bb2801 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:26.855462 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-d44455a5-86ff-4cc1-9712-a4e8889247bb req-73c01404-d545-4466-b1f6-474c66bb2801 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:26.863171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-d44455a5-86ff-4cc1-9712-a4e8889247bb req-73c01404-d545-4466-b1f6-474c66bb2801 service nova] Creating event network-changed:1f6310e3-403c-4493-a502-419db6a0cd7b for instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 on hv-cinder-84989 Aug 01 17:04:26.869130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-d44455a5-86ff-4cc1-9712-a4e8889247bb req-73c01404-d545-4466-b1f6-474c66bb2801 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031707 Aug 01 17:04:26.869916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 430/850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:04:53.658808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=14 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:53.659480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:53.663368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:53.663860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:53.669869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:53.670345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:53.671104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:53.671538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:53.694944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-153b0206-328d-4880-93d0-1f554200f7a1 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/ips" status: 200 len: 152 microversion: 2.20 time: 0.037641 Aug 01 17:04:53.695509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 421/851] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 1 17:04:53 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 17:04:56.819500 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:04:56.820194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:56.823071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:56.823864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=40 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:56.828793 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:56.832735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:56.832735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:56.832735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:56.854102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lazy-loading 'flavor' on Instance uuid ec1e758f-9380-400c-95ca-fc87c1d2fd53 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:04:57.291681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7d27ee0a-7d81-43c5-b9ba-9d884d17df80 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/action" status: 202 len: 0 microversion: 2.20 time: 0.476414 Aug 01 17:04:57.292270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 431/852] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 1 17:04:56 2022] POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:04:57.301191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:57.302277 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:57.309189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:57.309635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:57.310437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:57.310855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:57.496856 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:57.504954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:57.506544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:57.507722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e86d3ed9-6c59-44e2-b7a0-4eb9508f8421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.211093 Aug 01 17:04:57.508322 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 422/853] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:04:57 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:04:58.532439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:58.533136 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:58.540296 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:58.540741 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:58.541497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:58.541930 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:58.671983 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:58.679816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:58.681917 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:58.683092 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1121e567-521d-4d7f-815b-96c0fde3a71a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.155406 Aug 01 17:04:58.683656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 432/854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:04:58 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:04:59.706702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:04:59.707309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:04:59.714794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:59.715247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:59.716016 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:04:59.716454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:04:59.843730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:59.851624 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:59.853339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:04:59.854533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9866d225-f867-4637-a5c2-368f7fb4a221 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.151857 Aug 01 17:04:59.855093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 423/855] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:04:59 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:00.877507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:00.878082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:00.884684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:00.885139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:00.885908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:00.886385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:01.070169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:01.078094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:01.084410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:01.084410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7c5a6637-f29a-44b1-a167-a202ea8cd73d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.207244 Aug 01 17:05:01.084410 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 433/856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:00 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:02.104409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:02.105017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:02.111544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:02.112020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:02.112780 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:02.113214 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:02.244670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:02.252427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:02.253916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:02.255097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-801e3317-d194-4743-974c-05ed7ef25b4a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.154786 Aug 01 17:05:02.255657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 424/857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:02 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:03.278543 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:03.279169 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:03.285675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:03.286156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:03.286932 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:03.287366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:03.419229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:03.427099 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:03.428643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:03.429795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-82c1d6be-d4fe-41dc-b2a4-23beb797b756 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.155260 Aug 01 17:05:03.430397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 434/858] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:03 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:04.453881 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:04.454636 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:04.461705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:04.462190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:04.463018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:04.463498 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:04.590740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:04.598535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:04.600045 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:04.601307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34357b91-b111-433d-bba3-1dc1b700bb29 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.152259 Aug 01 17:05:04.601868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 425/859] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:04 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:05.625566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:05.626094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:05.632505 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:05.632950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:05.633705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:05.634831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:05.762605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:05.770395 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:05.771909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:05.773042 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-81afc591-8e23-41e5-b8c2-dff5f4ad338e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.151411 Aug 01 17:05:05.773596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 435/860] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:05 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:06.796997 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:06.797641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:06.804529 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:06.804984 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:06.805762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:06.806949 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:06.935922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:06.943849 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:06.945527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:06.947243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cef73fd2-bebb-4f7a-9a84-5a0f321c3000 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.153552 Aug 01 17:05:06.947945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 426/861] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:06 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:07.970499 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:07.971129 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:07.977559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:07.983596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:07.983596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:07.983596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:08.112290 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:08.120667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:08.122297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:08.123488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-83faf8ee-7a0c-4e9e-98ea-01dd10481731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.156837 Aug 01 17:05:08.124056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 436/862] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:07 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:09.147267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:09.147948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:09.154646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:09.155080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:09.155843 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:09.156282 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:09.290319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:09.298548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:09.300079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:09.301246 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-880178df-d255-4572-bd24-c089a2ce3985 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.157963 Aug 01 17:05:09.301808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 427/863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:09 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:10.327523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:10.328245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:10.334841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:10.335427 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:10.336233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:10.336671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:10.470090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:10.477826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:10.479762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:10.480919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d289d4dd-6c9b-4bb4-98c8-bb9b07059055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.159547 Aug 01 17:05:10.481475 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 437/864] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:10 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:11.505264 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:11.505698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:11.512490 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:11.512947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:11.513716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:11.514184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:11.717421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:11.725281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:11.726825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:11.728613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0285c7e4-3bec-4084-8dad-e488125b4afd tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.226917 Aug 01 17:05:11.729176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 428/865] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:11 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:12.752504 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:12.753112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:12.759898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:12.760344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:12.761104 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:12.761541 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:12.889556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:12.897704 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:12.899247 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:12.901668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4c07386d-492f-479e-9102-2993b1e98f01 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.153030 Aug 01 17:05:12.905073 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 438/866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:12 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:12.983741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-895556d8-83dc-4b79-86d0-31dccdf4024e req-dd1f6fa3-88ab-4b99-ac98-33b2831b9f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "name": "network-vif-plugged", "status": "completed", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:12.994281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-895556d8-83dc-4b79-86d0-31dccdf4024e req-dd1f6fa3-88ab-4b99-ac98-33b2831b9f13 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:12.994725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-895556d8-83dc-4b79-86d0-31dccdf4024e req-dd1f6fa3-88ab-4b99-ac98-33b2831b9f13 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:13.012657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-895556d8-83dc-4b79-86d0-31dccdf4024e req-dd1f6fa3-88ab-4b99-ac98-33b2831b9f13 service nova] Creating event network-vif-plugged:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:05:13.012657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-895556d8-83dc-4b79-86d0-31dccdf4024e req-dd1f6fa3-88ab-4b99-ac98-33b2831b9f13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Aug 01 17:05:13.012657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 429/867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:05:13.924770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:13.925382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:13.932510 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:13.932962 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:13.933735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:13.934203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:14.064951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:14.075511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:14.077671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:14.079373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-35a73e17-01a5-44ae-bf24-d854d81aa7ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.158345 Aug 01 17:05:14.079926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 439/868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:13 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:15.105982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:15.106696 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:15.112824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:15.113261 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:15.114010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:15.114722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:15.244395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:15.252218 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:15.253704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:15.254886 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1b4b54f0-9275-464d-b0b1-0c0e197a1447 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1746 microversion: 2.20 time: 0.154411 Aug 01 17:05:15.255441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 430/869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:15 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:16.278237 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:16.282833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:16.285402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:16.285848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:16.286682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:16.287118 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:16.418452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:16.426352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:16.427862 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:16.429006 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-70c4a515-7267-45c6-aedb-b42655c4671f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.154778 Aug 01 17:05:16.429571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 440/870] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:16 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:17.452713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:17.453314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:17.460245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:17.460756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:17.461542 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:17.462016 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:17.606494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:17.615100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:17.616603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:17.617797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-73a1c6ee-4a3c-46bc-b241-d96d64a45192 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.169104 Aug 01 17:05:17.618629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 431/871] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:17 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:18.641699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:18.642336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:18.649537 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:18.649982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:18.650791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:18.651259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:18.793786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:18.808623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:18.808623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:18.809656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-08301cce-e18e-4845-aabe-0fc8ec241731 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.171777 Aug 01 17:05:18.810552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 441/872] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:18 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:19.833224 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:19.833983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:19.840854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:19.841278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:19.842114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:19.842557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:19.997107 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:20.005462 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:20.007083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:20.008267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca883e9b-dcb5-4475-9679-6f2bf4356cec tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.179197 Aug 01 17:05:20.008835 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 432/873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:19 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:21.032476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:21.033340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:21.040411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:21.040871 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:21.041701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:21.042164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:21.190498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:21.199772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:21.201321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:21.202588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-40d76d61-c5c8-4bec-bd40-d5c9ee4137a7 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.174080 Aug 01 17:05:21.203282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 442/874] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:21 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:22.228890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:22.230357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:22.237512 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:22.237986 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:22.238815 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:22.239276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:22.381603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:22.394080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:22.395584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:22.397323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7a004183-9079-47a2-bc55-dc85694cc82b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.171947 Aug 01 17:05:22.397891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 433/875] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:22 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:23.421739 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:23.422596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:23.430020 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:23.430837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:23.432491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:23.433407 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:23.727038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:23.735805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:23.737313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:23.738493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d2e16531-af7f-4bad-8123-d5edf2582681 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.321407 Aug 01 17:05:23.739054 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 443/876] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:23 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:24.762467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:24.764204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:24.776836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:24.777301 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:24.778122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:24.778569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:24.962478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:24.971378 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:24.972911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:24.974102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b11e99bc-97dd-4e37-b6df-1913b6bb5968 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.216641 Aug 01 17:05:24.974953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 434/877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:24 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:25.999552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:26.000270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:26.007293 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:26.007745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:26.008576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:26.009045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:26.148562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:26.158413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:26.159906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:26.161061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2cdbf06d-e56b-48b0-85bf-46a1aa47d523 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.166452 Aug 01 17:05:26.161850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 444/878] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:25 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:27.185770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:27.186379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:27.193161 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:27.193604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:27.194378 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:27.194808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:27.522971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:27.522971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=83 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:27.522971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:27.523477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:27.523477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f55c3603-59db-457d-8a74-43680e56f6ef tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.162828 Aug 01 17:05:27.523477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 435/879] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:27 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:28.371723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:28.372378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:28.374464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=29 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:28.380592 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:28.381202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:28.382080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:28.382588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:28.389276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:28.527394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:28.534341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:28.535879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:28.537028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-40b5b981-c473-477b-951f-607cca85372b tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1741 microversion: 2.20 time: 0.170411 Aug 01 17:05:28.537578 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 445/880] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:28 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:29.560748 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:29.561361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:29.564002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=31 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:29.568936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:29.569445 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:29.570216 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:29.570654 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:29.741324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:29.749437 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:29.750976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:29.752153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e379eef7-aa63-44a4-85c1-a32383bff2e5 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1723 microversion: 2.20 time: 0.195628 Aug 01 17:05:29.752717 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 436/881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:29 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:30.775921 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:30.776617 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:30.783576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:30.784024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:30.784789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:30.785227 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:30.919718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:30.927669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:30.929189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:30.930413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4a6e7d95-38e2-49f1-97ef-87fe2c64bd2a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1723 microversion: 2.20 time: 0.158356 Aug 01 17:05:30.930967 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 446/882] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:30 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:31.954625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:31.955248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:31.961596 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:31.964544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:31.964544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:31.964544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:32.095659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:32.103613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:32.105731 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:32.106924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6b4c03b2-fbff-4221-a7b3-754c7f991d65 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1723 microversion: 2.20 time: 0.156255 Aug 01 17:05:32.110213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 437/883] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:31 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:33.027302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:33.027748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:33.034156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.034604 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.035364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.035796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.058813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e166c798-6481-477d-9e44-5aefd0bee797 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/ips" status: 200 len: 145 microversion: 2.1 time: 0.037407 Aug 01 17:05:33.060047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 447/884] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:05:33 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:05:33.131109 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:33.131825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:33.139307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.139751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.140521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.140952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.261457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-777212b7-bc8c-4d84-9314-c57c86b650ff req-c46f4456-c2da-4830-870f-e87f6923e6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "name": "network-vif-unplugged", "status": "completed", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:33.272840 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-777212b7-bc8c-4d84-9314-c57c86b650ff req-c46f4456-c2da-4830-870f-e87f6923e6c2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.273668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-777212b7-bc8c-4d84-9314-c57c86b650ff req-c46f4456-c2da-4830-870f-e87f6923e6c2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.284643 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:33.285401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.compute.server_external_events [req-777212b7-bc8c-4d84-9314-c57c86b650ff req-c46f4456-c2da-4830-870f-e87f6923e6c2 service nova] Unable to find a host for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53. Dropping event network-vif-unplugged {{(pid=124835) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 17:05:33.286303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-777212b7-bc8c-4d84-9314-c57c86b650ff req-c46f4456-c2da-4830-870f-e87f6923e6c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029491 Aug 01 17:05:33.286891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 448/885] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 17:05:33.295226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:33.296417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:33.299148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-715ddef3-dcc8-42a0-b048-3fa718b5193e tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1666 microversion: 2.20 time: 0.172056 Aug 01 17:05:33.300236 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 438/886] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:33 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:33.322572 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9552747-70c2-4a7d-a981-7d3dfea7238c"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:33.325496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:33.331894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.335901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:33.335901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:33.335901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:34.341936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5eb100ab-d261-4035-839f-944c0139beff tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.023301 Aug 01 17:05:34.342589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 449/887] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 1 17:05:33 2022] POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments => generated 188 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 17:05:34.463486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:34.464002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:34.470390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:34.470842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:34.471609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:34.472047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:34.713201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd05e725-7df4-4229-aa47-2d101653c18e"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:34.716236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:34.722295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:34.722744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:34.723555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:34.723938 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:35.044927 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3c7637fd-e830-4d9a-b600-c141106088d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments/c9552747-70c2-4a7d-a981-7d3dfea7238c" status: 202 len: 0 microversion: 2.20 time: 0.585284 Aug 01 17:05:35.045549 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 439/888] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 1 17:05:34 2022] DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments/c9552747-70c2-4a7d-a981-7d3dfea7238c => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:05:35.110684 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:35.111339 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:35.118350 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:35.118801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:35.119570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:35.120008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:35.166098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124837) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 17:05:35.481634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-64e1ee0f-227d-4835-a41c-f6f933607c88 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/action" status: 202 len: 0 microversion: 2.20 time: 0.374849 Aug 01 17:05:35.482561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 440/889] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 1 17:05:35 2022] POST /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 17:05:35.490547 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:35.491159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:35.498057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:35.498515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:35.499284 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:35.499738 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:35.529764 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7c6bee92-a60f-4f1f-b036-cfd54e7a6369 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820515 Aug 01 17:05:35.534703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 450/890] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:05:34 2022] POST /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:05:35.651272 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:35.661735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:35.663540 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:35.664724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-550a9db8-af62-435c-936e-afcbe75284f9 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1674 microversion: 2.20 time: 0.178162 Aug 01 17:05:35.665678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 441/891] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:35 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:36.690136 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:36.690868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:36.697165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:36.697614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:36.698970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:36.699402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:36.830984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:36.840003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:36.841515 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:36.842746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d0a988c8-ef2c-445e-8f3f-6b8b4c22325a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1674 microversion: 2.20 time: 0.157512 Aug 01 17:05:36.843308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 451/892] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:36 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:37.866972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:37.875189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:37.875189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:37.875436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:37.876157 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:37.876596 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:38.273659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:38.283329 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:38.284844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:38.286785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ed4c9f30-6cf6-47cf-9822-e4a2f7cf2791 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.423532 Aug 01 17:05:38.287366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 442/893] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:37 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:38.851946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:38.856179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:38.873965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:38.874443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:38.875229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:38.875657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:38.919471 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:05:38.946322 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-fc89ad4d-9967-4e4a-add3-4b25a1a725b0 req-2fe1e301-f2df-4cf0-b502-27cec1845b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:38.957459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fc89ad4d-9967-4e4a-add3-4b25a1a725b0 req-2fe1e301-f2df-4cf0-b502-27cec1845b8a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:38.957910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fc89ad4d-9967-4e4a-add3-4b25a1a725b0 req-2fe1e301-f2df-4cf0-b502-27cec1845b8a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:38.969664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-fc89ad4d-9967-4e4a-add3-4b25a1a725b0 req-2fe1e301-f2df-4cf0-b502-27cec1845b8a service nova] Creating event network-changed:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:05:38.975085 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-fc89ad4d-9967-4e4a-add3-4b25a1a725b0 req-2fe1e301-f2df-4cf0-b502-27cec1845b8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130368 Aug 01 17:05:38.976244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 443/894] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:05:39.241071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-14701400-bfc8-460e-bb27-beb0f1d2d8f8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 204 len: 0 microversion: 2.1 time: 0.399839 Aug 01 17:05:39.242826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 452/895] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:05:38 2022] DELETE /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 17:05:39.251836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:39.252662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:39.259824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:39.260279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:39.261799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:39.262311 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:39.315414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:39.316364 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:39.340123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:39.340606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:39.341534 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:39.342112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:39.439538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:39.451951 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5aa19b41-ded2-45e4-88d9-1b378b686534 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.204494 Aug 01 17:05:39.452636 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 444/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:39 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:39.499933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:39.508177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:39.509685 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:39.510847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1850ef90-1ad0-4e88-8b8b-078f0681f184 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.201049 Aug 01 17:05:39.511613 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 453/897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:39 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:40.474921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:40.475534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:40.482822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:40.483364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:40.484171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:40.484626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:40.534233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:40.534848 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:40.542096 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:40.543148 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:40.544446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:40.545288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:40.631387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:40.641964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9dffc544-58be-42c5-b042-dbc2a74371a2 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.170808 Aug 01 17:05:40.643779 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 445/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:40 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:40.705861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:40.714849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:40.716575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:40.717803 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a95bc29a-55be-484d-aacd-134346b2a403 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.187488 Aug 01 17:05:40.718400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 454/899] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:40 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:41.664667 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:41.665295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:41.672409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:41.672855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:41.673612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:41.674063 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:41.741439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:41.742171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:41.751806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:41.752497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:41.753362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:41.753873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:41.838354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:41.847211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3452526a-5408-4288-94a7-4a1dfdbfcbdd tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.186527 Aug 01 17:05:41.847972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 446/900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:41 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:41.891575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:41.901736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:41.902116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:41.904111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6a7d70cc-13bd-45b6-baca-7e836e335421 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.167136 Aug 01 17:05:41.906082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 455/901] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:41 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:42.868096 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:42.868744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:42.875484 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:42.875936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:42.876704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:42.877140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:42.927938 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:42.928670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:42.935158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:42.935623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:42.936483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:42.936977 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:43.068607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:43.076208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5fb4f4d6-9daa-46b4-a13a-31d9a4770ff7 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.212148 Aug 01 17:05:43.076795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 447/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:42 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:43.111626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:43.120208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:43.121835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:43.123028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c0aa897f-da8f-49e6-96e2-634b2687c5dc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.199026 Aug 01 17:05:43.123583 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 456/903] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:42 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:44.097471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:44.102795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:44.105267 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:44.105739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:44.106726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:44.107165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:44.148569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:44.149275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:44.157216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:44.157740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:44.158654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:44.159100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:44.161985 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:44.278467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:44.291130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4e693fd3-fcb6-402f-ba16-583a5b47beae tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.197571 Aug 01 17:05:44.292287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 448/904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:44 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:44.319378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:44.328065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:44.329564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:44.330808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-df8f77b4-1ea2-4593-85fb-8c69ac12c280 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.186239 Aug 01 17:05:44.331665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 457/905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:44 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:45.315053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:45.315819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:45.322507 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:45.322945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:45.323720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:45.324153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:45.344991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:45.354806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:45.361089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:45.362350 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:45.362796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:45.363596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:45.364029 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:45.468812 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:45.477662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-409c29ab-85c0-4e73-a382-310b046397aa tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.166560 Aug 01 17:05:45.478917 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 449/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:45 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:45.523834 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:45.533258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:45.534822 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:45.535996 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-526337e2-df17-4be5-b31f-3cdc1c9803de tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.185374 Aug 01 17:05:45.537206 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 458/907] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:45 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:46.501693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:46.503086 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:46.511118 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:46.511704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:46.512705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:46.513216 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:46.561432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:46.562018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:46.570711 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:46.571306 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:46.572918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:46.573584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:46.665439 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:46.676316 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ac6eaeab-9c23-46f0-88ef-31d07771636c tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.180162 Aug 01 17:05:46.676914 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 450/908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:46 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:46.728833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:46.733755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:46.735371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:46.737001 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-80f2a113-442f-4f9e-b831-09248c428da4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.180198 Aug 01 17:05:46.738413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 459/909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:46 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:47.696732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:47.697449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:47.704213 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:47.704669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:47.705482 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:47.705929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:47.762958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:47.764535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:47.772837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:47.774346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:47.775456 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:47.776447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:47.861530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:47.869873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6e8a7ee4-ade4-42ad-804e-bff40698a77a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.176906 Aug 01 17:05:47.870459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 451/910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:47 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:47.936533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:47.944961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:47.946815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:47.947919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-919800c4-febc-4d34-8496-a21e2027d082 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.189552 Aug 01 17:05:47.948690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 460/911] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:47 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:48.892546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:48.893229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:48.901846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:48.901846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:48.901846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:48.901846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:48.984335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:48.984335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:48.984335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:48.987628 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:48.991185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:48.991185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:49.068067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:49.076990 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-65007f51-d2ea-4403-be9d-1f40e0842be5 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.188152 Aug 01 17:05:49.078009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 452/912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:48 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:49.148482 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:49.157270 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:49.158934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:49.160214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-51476d8c-f1a2-42d6-95c2-3e23947c2dfb tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.192145 Aug 01 17:05:49.161012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 461/913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:48 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:50.099974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:50.100595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:50.107113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:50.107568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:50.108463 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:50.109458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:50.184850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:50.186195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:50.193874 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:50.194709 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:50.195726 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:50.196377 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:50.258592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:50.269564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9540a9a8-fbb8-4b7d-b1df-3bf72bfd5c64 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.173353 Aug 01 17:05:50.275553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 453/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:50 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:50.360184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:50.369012 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:50.370691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:50.371869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a6b3c81e-4d4b-4e36-aaf5-ae4165b2f39d tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.191027 Aug 01 17:05:50.372643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 462/915] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:50 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:51.295960 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:51.297291 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:51.303735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:51.304207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:51.304973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:51.305412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:51.395386 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:51.396101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:51.402602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:51.403123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:51.403958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:51.404463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:51.436817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:51.444480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e77b15fb-4dea-4b24-a19b-bff591b4c9ef tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.152382 Aug 01 17:05:51.445066 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 454/916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:51 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:51.537678 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:51.545424 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:51.547183 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:51.548274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-1d8aefe0-0390-4e45-bbaf-a10566265838 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.156822 Aug 01 17:05:51.548824 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 463/917] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:51 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:52.466114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:52.466753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:52.473735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:52.474207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:52.474961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:52.475390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:52.571287 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:52.571950 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:52.579048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:52.579493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:52.580271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:52.580716 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:52.610436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:52.618416 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f61d60df-15c4-42df-9018-ee47174927c8 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.156119 Aug 01 17:05:52.619005 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 455/918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:52 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:52.709634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:52.717625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:52.719141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:52.720295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c75caccd-33d4-4503-b778-e3ed24ebe5c2 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.153055 Aug 01 17:05:52.720885 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 464/919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:52 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:05:53.639818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:53.641029 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:53.647523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:53.648074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:53.648879 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:53.649315 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:53.744440 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:53.745083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:53.751668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:53.752019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:53.752792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:53.753229 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:53.781461 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:53.789013 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-39fc7298-4160-4229-bb24-b114dfc72674 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.153057 Aug 01 17:05:53.789596 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 456/920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:53 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:53.881226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:53.889070 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:53.891158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:53.892325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-96e971a6-e98d-4e35-943f-a5e17514447c tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.151747 Aug 01 17:05:53.892920 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 465/921] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:53 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:54.810348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:54.810977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:54.817844 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:54.818331 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:54.819095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:54.819533 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:54.915568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:54.916259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:54.922821 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:54.923256 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:54.924028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:54.924484 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:54.955090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:54.968158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-95b9d60c-f0ea-4104-ac30-e1f89bcf857a tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.161680 Aug 01 17:05:54.968962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 457/922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:54 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:05:55.067071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:55.075070 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:55.076574 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:55.078477 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-96e50350-61b7-4bbe-9647-bd548f447412 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.166045 Aug 01 17:05:55.079046 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 466/923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:54 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:55.989390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:55.989944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:55.996885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:55.997333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:55.998123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:55.998558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:56.101718 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:56.105137 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:56.108810 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:56.109258 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:56.110025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:56.110509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:56.130177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:56.137656 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8fae4c77-1c65-4687-af45-02d1c40992ea tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.152734 Aug 01 17:05:56.138266 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 458/924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:55 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:56.240095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:56.248135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:56.249643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:56.251600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-14525c13-9106-436d-be96-905fa370de61 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.153155 Aug 01 17:05:56.252155 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 467/925] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:56 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:57.159592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:57.160217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:57.166812 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:57.167265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:57.168078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:57.168516 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:57.275386 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:57.276281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:57.283385 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:57.283834 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:57.284637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:57.285060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:57.305168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:57.312870 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d4e8e7d4-427b-45a6-bf70-6b8aa0a6392b tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1569 microversion: 2.1 time: 0.157972 Aug 01 17:05:57.313581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 459/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:57 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:57.417532 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:57.425798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:57.427347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:57.428547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3b74b58d-aba4-491f-aa85-253d3359ff26 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.157055 Aug 01 17:05:57.429117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 468/927] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:57 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:58.334478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:58.335987 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:58.343996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:58.345378 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:58.345378 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:58.346306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:58.451405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:58.452016 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:58.456714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:58.460254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:58.465952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:58.465952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:58.465952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:58.600067 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:58.602026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:58.608127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42e3f6ae-78a3-4389-b356-75798b985988 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1450 microversion: 2.1 time: 0.277533 Aug 01 17:05:58.608938 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 460/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:58 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1450 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:58.611031 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:58.612680 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:58.614240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-695c806e-83db-4cb0-9730-f59fee623eac tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.166615 Aug 01 17:05:58.618405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 469/929] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:58 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:05:58.980352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-2a6753ec-a5ad-41e3-beea-2aa70b051dfe req-48346a84-571a-4c7e-acbd-dc5dd5183230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98630e53-1572-4ebc-9c74-3050a9ff16a3", "name": "network-vif-deleted", "tag": "b159fbfb-f373-4a4b-b053-8ea13c4f6713"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:05:58.988280 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2a6753ec-a5ad-41e3-beea-2aa70b051dfe req-48346a84-571a-4c7e-acbd-dc5dd5183230 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:58.988735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2a6753ec-a5ad-41e3-beea-2aa70b051dfe req-48346a84-571a-4c7e-acbd-dc5dd5183230 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:58.992176 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:58.994597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:59.000120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-2a6753ec-a5ad-41e3-beea-2aa70b051dfe req-48346a84-571a-4c7e-acbd-dc5dd5183230 service nova] Creating event network-vif-deleted:b159fbfb-f373-4a4b-b053-8ea13c4f6713 for instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 on hv-cinder-84989 Aug 01 17:05:59.001464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.001979 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.002841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.003366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.006491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-2a6753ec-a5ad-41e3-beea-2aa70b051dfe req-48346a84-571a-4c7e-acbd-dc5dd5183230 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Aug 01 17:05:59.007099 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 461/930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:05:59.035657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d82b3942-1890-44b8-89b8-2d11afa0d4bd tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048107 Aug 01 17:05:59.036239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 470/931] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:05:58 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:05:59.048547 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:59.049164 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:59.055690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.061390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.061390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.061390 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.086234 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f0dc6a92-541d-455d-8f5b-ea1c7900199a tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e" status: 200 len: 194 microversion: 2.1 time: 0.042913 Aug 01 17:05:59.086809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 462/932] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 1 17:05:59 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:05:59.631860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:59.631860 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:59.637180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.637639 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.638466 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.638908 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.639174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:05:59.639897 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:05:59.661240 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:59.663154 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.663730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.664579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:05:59.665087 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:05:59.710146 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a2a503fa14203bcf5b98bfbcccbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26251afa3c5e43839015776368defa1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:59.721823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-210f2c91-bde7-441d-bee3-0517db479c79 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 200 len: 1220 microversion: 2.1 time: 0.095370 Aug 01 17:05:59.726565 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 471/933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:05:59 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:05:59.818952 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:59.827595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:59.829794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:05:59.831035 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-89ca9664-5178-4ea3-94d9-6ce9ba9591ee tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.197775 Aug 01 17:05:59.831590 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 463/934] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:05:59 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:06:00.599866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:00.600355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:00.606322 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.606796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.607556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.607980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.633170 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8b0b47db-f63d-4f73-b940-f2498a40c02c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/ips" status: 200 len: 149 microversion: 2.1 time: 0.037810 Aug 01 17:06:00.633794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 472/935] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:06:00 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:00.688337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1136253-9a24-4feb-a92c-163077048698"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:00.691170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:00.697499 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.697946 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.698744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.699177 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.747575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:00.748189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] [instance: 98630e53-1572-4ebc-9c74-3050a9ff16a3] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:00.755763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.756215 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.756993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.757432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.771798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] HTTP exception thrown: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Request method failure captured: Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 HTTP/1.1 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AZko_sUyIjDJNSHX8Thceioj67R7bUqFJIF2bZt7QDsQjFi5TND1FMIBjfva95_QocMAUXmqx3ah_neEwEi6HW9GUAmFOgl2QwSX1ueaiFkCdHIzVGj0mBx-bP7HB2CQsWswmePwTnhsh2ib0TwUThBhupLS-56BMKMDcct-C4_z24 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 26251afa3c5e43839015776368defa1d Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestShelveInstance-1587906916 Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:06:00.774193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26251afa3c5e43839015776368defa1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26251afa3c5e43839015776368defa1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26251afa3c5e43839015776368defa1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26251afa3c5e43839015776368defa1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestShelveInstance-1587906916 Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 26251afa3c5e43839015776368defa1d Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestShelveInstance-1587906916 Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestShelveInstance-1587906916-project Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 8c4a2a503fa14203bcf5b98bfbcccbf8 Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestShelveInstance-1587906916-project Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. Aug 01 17:06:00.775633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '98630e53-1572-4ebc-9c74-3050a9ff16a3'} Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:00.776557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. Aug 01 17:06:00.779000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:00.781210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Returning 404 to user: Instance 98630e53-1572-4ebc-9c74-3050a9ff16a3 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:00.781210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-60bcd943-b10d-4833-8611-bb28db66c4e1 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3" status: 404 len: 111 microversion: 2.1 time: 0.031856 Aug 01 17:06:00.781210 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 473/936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:00 2022] GET /compute/v2.1/servers/98630e53-1572-4ebc-9c74-3050a9ff16a3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:00.854933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:00.855615 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:00.861668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.862163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:00.863516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:00.864201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:01.038625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:01.041975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=100 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:01.047904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:01.050295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:01.051893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ecff98e8-a195-4446-975b-e369a74c322a tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.201007 Aug 01 17:06:01.053211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 474/937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:06:00 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:06:01.057953 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f3342a89-5310-40d4-8f28-3c872d22a014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] Calling method '.version_select at 0x7f733dab7b80>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:01.161177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f3342a89-5310-40d4-8f28-3c872d22a014 tempest-TestShelveInstance-1587906916 tempest-TestShelveInstance-1587906916-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2022994459" status: 202 len: 0 microversion: 2.1 time: 0.106760 Aug 01 17:06:01.161825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 475/938] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 1 17:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2022994459 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:06:01.501170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-019a0c8a-e61a-41b0-be25-273b3bbaef3b tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "POST /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816843 Aug 01 17:06:01.504543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 464/939] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:06:00 2022] POST /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:01.545157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-c3e860a5-2087-4163-b2c5-6e1323b31a4c req-1643de77-edf2-4e75-ad8f-679e6530f069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "name": "network-vif-plugged", "status": "completed", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:01.572314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c3e860a5-2087-4163-b2c5-6e1323b31a4c req-1643de77-edf2-4e75-ad8f-679e6530f069 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:01.573849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-c3e860a5-2087-4163-b2c5-6e1323b31a4c req-1643de77-edf2-4e75-ad8f-679e6530f069 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:01.587528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-c3e860a5-2087-4163-b2c5-6e1323b31a4c req-1643de77-edf2-4e75-ad8f-679e6530f069 service nova] Creating event network-vif-plugged:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:06:01.592656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-c3e860a5-2087-4163-b2c5-6e1323b31a4c req-1643de77-edf2-4e75-ad8f-679e6530f069 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116755 Aug 01 17:06:01.593255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 476/940] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:06:02.077436 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:02.078179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:02.084962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:02.088713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:02.088713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:02.088713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:02.106430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:02.349875 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:02.357811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:02.359353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:02.360531 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-77ae340a-5065-4be1-8919-77c73be83e13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.288024 Aug 01 17:06:02.361101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 465/941] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:06:02 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:06:03.386255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:03.387125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:03.398478 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:03.398937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:03.399780 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:03.400228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:03.505302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5e47f18-1e9b-4b3d-af32-0d7651f3e83c"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:03.508899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:03.516209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:03.517449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:03.519011 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:03.519626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:03.555016 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:03.563831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:03.565910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:03.568839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-57264123-e9f2-43ed-a011-bb8bab55c611 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.187380 Aug 01 17:06:03.570145 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 477/942] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:06:03 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:06:04.256751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-58e27db4-30b5-496d-9b0f-663b4be6a302 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755843 Aug 01 17:06:04.259642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 466/943] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:06:03 2022] POST /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:06:04.592852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:04.593465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:04.601038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:04.601566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:04.613205 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:04.613507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:04.868599 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:04.877594 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:04.879689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:04.881080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bab9c262-4f05-4ead-b41d-2e39514d94ba tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1732 microversion: 2.20 time: 0.292298 Aug 01 17:06:04.882008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 478/944] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:06:04 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1732 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:06:05.904527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:05.905521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:05.912923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:05.913458 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:05.914328 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:05.914890 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:06.124388 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:06.133065 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:06.135054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:06.135773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a727eef8-4d80-4b8a-b9b6-02343c55b6bf tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1719 microversion: 2.20 time: 0.236122 Aug 01 17:06:06.136337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 467/945] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:06:05 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:06:11.177352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:11.179627 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:11.185880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.186365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.187128 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.187562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.216866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b0f7540e-fe75-4689-bfb5-715c5b2899ff tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044004 Aug 01 17:06:11.217413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 479/946] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:06:11 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:11.355186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:11.355714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:11.362370 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.362820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.363704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.364415 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.392097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5c981642-e3ec-46c1-b388-a3903cbd3016 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e" status: 200 len: 194 microversion: 2.1 time: 0.040898 Aug 01 17:06:11.392672 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 468/947] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 1 17:06:11 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:11.403623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:11.404124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:11.410125 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.411356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.412122 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:11.412587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:11.492251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lazy-loading 'services' on Instance uuid 1eb11ea4-ac85-43d4-a159-9c03a59c6827 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:06:11.655692 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-867750bf-5546-48a9-bc5d-77b7fecde85d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e" status: 202 len: 0 microversion: 2.1 time: 0.255962 Aug 01 17:06:11.656835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 480/948] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:06:11 2022] DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/cd05e725-7df4-4229-aa47-2d101653c18e => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:06:18.180815 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-086498fa-4492-458c-8cb3-03be76c31b91 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: .version_select at 0x7f733dcbed30>, body: {"keypair": {"name": "tempest-keypair-1442004950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaU4fgskeOp0z0xpiL+bEtkEWNTaFqab97VihQMAtWHws/mPUSl81NG1QJOCq/f7JbucflH1ce2gZW90z1j8lZipJdBYfgnjA9cdkX74F2YRO+wZlMNF+aLN8iAyv8q7A=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:18.198197 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-086498fa-4492-458c-8cb3-03be76c31b91 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:06:18.202076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-086498fa-4492-458c-8cb3-03be76c31b91 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:06:18.314392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-086498fa-4492-458c-8cb3-03be76c31b91 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137465 Aug 01 17:06:18.314991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 469/949] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:06:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:19.127958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:19.128558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:19.135750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:19.136203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:19.136976 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:19.137414 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:19.166738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-72c5f59b-1be0-4034-b4a8-3cd2c7858702 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/c1136253-9a24-4feb-a92c-163077048698" status: 200 len: 194 microversion: 2.1 time: 0.044041 Aug 01 17:06:19.167356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 481/950] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 1 17:06:19 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/c1136253-9a24-4feb-a92c-163077048698 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:19.178236 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:19.178832 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:19.185127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:19.185709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:19.186392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:19.186829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:19.269184 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lazy-loading 'services' on Instance uuid 1eb11ea4-ac85-43d4-a159-9c03a59c6827 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:06:19.479317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-58bb0e1f-1fe1-4e31-a396-dd29e826356c tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/c1136253-9a24-4feb-a92c-163077048698" status: 202 len: 0 microversion: 2.1 time: 0.305094 Aug 01 17:06:19.480049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:06:19 2022] DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments/c1136253-9a24-4feb-a92c-163077048698 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:06:20.402976 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-286200328", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ade5d3a-dad9-4932-9ac9-db242643b6f5"}], "security_groups": [{"name": "tempest-securitygroup--1799692103"}], "key_name": "tempest-keypair-1442004950", "user_data": "}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:20.510274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] validate_networks() for [('6ade5d3a-dad9-4932-9ac9-db242643b6f5', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:06:20.659036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:20.662056 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:20.668411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.669804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.669804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.670061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.700625 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c268d325-7b7b-44af-96d9-8b6344ea6267 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046330 Aug 01 17:06:20.701206 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 471/952] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:06:20 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 17:06:20.823491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:20.825784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:20.832808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.833346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.834153 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.834592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.862863 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-246f8a2b-ebc7-4254-821a-d67754afed51 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044087 Aug 01 17:06:20.864237 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 472/953] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:06:20 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 17:06:20.939841 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:20.940341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:20.947686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.948252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.948901 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:20.949341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:20.975115 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:06:21.021582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:06:21.021582 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:06:21.021837 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:06:21.022019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:06:21.022471 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:06:21.031217 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:21.031665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:21.032464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:21.032907 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:21.050084 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:06:21.054212 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:06:21.065088 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:06:21.067573 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:06:21.181957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [e4a2dc85-ed32-42f8-96bb-96057c283756] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 17:06:21.284245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fd33108a-7134-4a8e-addf-4f92a280b97d tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 204 len: 0 microversion: 2.1 time: 0.348118 Aug 01 17:06:21.284839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 473/954] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:06:20 2022] DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 17:06:21.293880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:21.294626 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:21.301523 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:21.301974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:21.302759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:21.303194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:21.440296 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:21.447995 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2c2daef-f34c-4094-a78e-24f87ac0b333 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1672 microversion: 2.1 time: 0.158140 Aug 01 17:06:21.451056 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 474/955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:21 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:22.189000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [e4a2dc85-ed32-42f8-96bb-96057c283756] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52888. Aug 01 17:06:22.193493 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c6dd2fe0-df88-42b9-a784-300dc174a391 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.795667 Aug 01 17:06:22.194171 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 482/956] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:06:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:06:22.204754 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b6e5d521-1a28-45ef-b7c8-537f3f81594a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:22.205360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b6e5d521-1a28-45ef-b7c8-537f3f81594a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:22.258360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b6e5d521-1a28-45ef-b7c8-537f3f81594a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:22.264921 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b6e5d521-1a28-45ef-b7c8-537f3f81594a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1241 microversion: 2.1 time: 0.063931 Aug 01 17:06:22.265486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 475/957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:22 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:22.469015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:22.469631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:22.477491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:22.477927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:22.478724 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:22.479165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:22.612492 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:22.620481 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-052d1b18-533a-4330-9ca4-8a2c02bb7385 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1672 microversion: 2.1 time: 0.155822 Aug 01 17:06:22.621053 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 483/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:22 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:23.287143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:23.287711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:23.295667 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:23.296123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:23.297093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:23.297532 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:23.363494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:23.372564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-56f339bd-04f8-47de-b2bc-20a237e92589 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1237 microversion: 2.1 time: 0.089812 Aug 01 17:06:23.373336 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 476/959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:23 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:23.641469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:23.642102 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:23.649426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:23.649876 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:23.650674 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:23.651112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:23.784753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:23.792686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0e935f35-9339-41ff-92bc-6c692059fedf tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1672 microversion: 2.1 time: 0.155099 Aug 01 17:06:23.793259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 484/960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:23 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:24.283907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-c4796751-9787-4b7b-8fd7-b3c3fe2a9d70 req-e168608d-e78c-48a3-a921-4a26f13eff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb11ea4-ac85-43d4-a159-9c03a59c6827", "name": "network-vif-deleted", "tag": "ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:24.298052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c4796751-9787-4b7b-8fd7-b3c3fe2a9d70 req-e168608d-e78c-48a3-a921-4a26f13eff4f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.299245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c4796751-9787-4b7b-8fd7-b3c3fe2a9d70 req-e168608d-e78c-48a3-a921-4a26f13eff4f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.312845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-c4796751-9787-4b7b-8fd7-b3c3fe2a9d70 req-e168608d-e78c-48a3-a921-4a26f13eff4f service nova] Creating event network-vif-deleted:ab1b8e29-70a2-4aa4-a9b6-b96bbd340d3f for instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 on hv-cinder-84989 Aug 01 17:06:24.319755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-c4796751-9787-4b7b-8fd7-b3c3fe2a9d70 req-e168608d-e78c-48a3-a921-4a26f13eff4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039334 Aug 01 17:06:24.320964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 477/961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:24.394204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:24.396551 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:24.405730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.405730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.405730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.406026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.498146 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:24.511288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2848031d-d754-41b6-bc5b-5f5a514d4b2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1299 microversion: 2.1 time: 0.121016 Aug 01 17:06:24.512756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 485/962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:24 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:24.814868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:24.815769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:24.823074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.827939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.827939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.827939 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.860141 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:24.860598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:24.861161 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lazy-loading 'fault' on Instance uuid 1eb11ea4-ac85-43d4-a159-9c03a59c6827 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:06:24.945786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2079b0fbf7b4a8c88d2522da9f2c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3d55c8b96e4821bd2592a3ee665533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:24.954615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-09263d2d-ddce-473d-97c1-eb856de3f3e2 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 200 len: 1326 microversion: 2.1 time: 0.143878 Aug 01 17:06:24.955782 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 478/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:24 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:25.533267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:25.533903 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:25.541190 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:25.541637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:25.542431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:25.542861 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:25.770788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:25.778315 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b69df8ae-7bb0-4844-8e5f-ecde58441c4b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.248828 Aug 01 17:06:25.782794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 486/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:25 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:25.976321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:25.976936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:25.983067 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:25.983517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:25.984321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:25.984816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:26.001691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 HTTP/1.1 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:06:26.003449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:26.005127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '1eb11ea4-ac85-43d4-a159-9c03a59c6827'} Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:26.006226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:26.007784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:26.010280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:26.011130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b413e4ee-783f-4a9b-9b80-ffc803341d22 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 404 len: 111 microversion: 2.1 time: 0.039657 Aug 01 17:06:26.011687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 487/965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:25 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:06:26.019969 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-845ef8a7-a3ec-413b-90b8-cd40a5399cb9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '.version_select at 0x7f733d8ff280>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:26.089953 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-8d5b2ff4-eedc-4759-b913-8aad54bab2c4 req-33b65c06-f497-4662-a58f-07e483a71f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0", "tag": "46e5e004-b44c-4010-9e82-75cec9d67ff5"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:26.099979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8d5b2ff4-eedc-4759-b913-8aad54bab2c4 req-33b65c06-f497-4662-a58f-07e483a71f30 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:26.100420 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8d5b2ff4-eedc-4759-b913-8aad54bab2c4 req-33b65c06-f497-4662-a58f-07e483a71f30 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:26.102886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-845ef8a7-a3ec-413b-90b8-cd40a5399cb9 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853227624" status: 202 len: 0 microversion: 2.1 time: 0.086649 Aug 01 17:06:26.103690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 1 17:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853227624 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 17:06:26.111661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-8d5b2ff4-eedc-4759-b913-8aad54bab2c4 req-33b65c06-f497-4662-a58f-07e483a71f30 service nova] Creating event network-changed:46e5e004-b44c-4010-9e82-75cec9d67ff5 for instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 on hv-cinder-84989 Aug 01 17:06:26.117248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-8d5b2ff4-eedc-4759-b913-8aad54bab2c4 req-33b65c06-f497-4662-a58f-07e483a71f30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167558 Aug 01 17:06:26.117930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 479/967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:26.799805 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:26.800426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:26.808488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:26.808968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:26.809719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:26.810185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:27.031369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:27.039948 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6b7812f2-eb3f-4c58-8ddf-365ccebd3263 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.244114 Aug 01 17:06:27.040518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 489/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:26 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:28.061746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:28.062481 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:28.068612 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:28.069057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:28.069806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:28.070300 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:28.206815 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:28.215404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-adb9f99c-a160-4f83-abb5-9509018ffbe4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.158397 Aug 01 17:06:28.215973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 480/969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:28 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:29.236674 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:29.237302 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:29.240239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:29.245034 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.245483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.246281 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.246733 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.471675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:29.480065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bbec9769-d56e-4f05-8289-f3f915954861 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.247390 Aug 01 17:06:29.480705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 490/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:29 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:29.890312 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:29.890796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:29.893211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:29.899093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.899558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.900326 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.900764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.915345 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 HTTP/1.1 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:06:29.917076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.918711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '1eb11ea4-ac85-43d4-a159-9c03a59c6827'} Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:29.919556 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.920854 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.922167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:29.922167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ebf2665a-f715-43fb-9409-a8c1eee8b431 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 404 len: 111 microversion: 2.1 time: 0.032269 Aug 01 17:06:29.922167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 481/971] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:06:29 2022] DELETE /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:29.927791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:29.928539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: 1eb11ea4-ac85-43d4-a159-9c03a59c6827] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:29.934690 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.935143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.935909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:29.936345 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:29.950731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 HTTP/1.1 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:06:29.952382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.953966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '1eb11ea4-ac85-43d4-a159-9c03a59c6827'} Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:29.954965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. Aug 01 17:06:29.956461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:29.957936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance 1eb11ea4-ac85-43d4-a159-9c03a59c6827 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:29.957936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b16a4324-f727-4590-989f-014a6c9eabe4 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827" status: 404 len: 111 microversion: 2.1 time: 0.030448 Aug 01 17:06:29.957936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 491/972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:29 2022] GET /compute/v2.1/servers/1eb11ea4-ac85-43d4-a159-9c03a59c6827 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:30.501205 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:30.501751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:30.509066 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:30.509526 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:30.510405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:30.510847 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:30.514948 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:30.644595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:30.652150 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b0bf46fe-6fbc-42cc-8996-4c4dc51b5990 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.155063 Aug 01 17:06:30.652725 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 482/973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:30 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:31.232686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:31.233195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:31.235524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:31.236184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:31.242236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.242696 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.243469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.248869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.248869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:31.258512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 HTTP/1.1 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:06:31.260057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.261614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'eac7cea8-b1f2-4104-bb3b-083dcacbf502'} Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:31.262567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.264019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.265404 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:31.265404 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-93bb6868-ef12-4b2d-bc29-286042dac0ed tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 404 len: 111 microversion: 2.1 time: 0.032611 Aug 01 17:06:31.265404 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 492/974] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:06:31 2022] DELETE /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:31.270922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:31.271576 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] [instance: eac7cea8-b1f2-4104-bb3b-083dcacbf502] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:31.278732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.279178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.279944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.280379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.296479 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] HTTP exception thrown: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Request method failure captured: Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 HTTP/1.1 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AVsDjPq1mHnvY28mJe1PpEoRbjM-fSM4zpZjnDo5ZSbiMLLjG419mrm0Kz1TpdPpgSkiZwXAIHndoVYyoX9U48STNknvKVXe9O2lKtpzt_qvZkmv_SsMgzUzmhz2POZzMwJ2tMHgEufGGiL63OeDvq5Ug9aR6yVsdRgPfAYteR2E4E Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:06:31.297998 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee3d55c8b96e4821bd2592a3ee665533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: ee3d55c8b96e4821bd2592a3ee665533 Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402514228 Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: c2079b0fbf7b4a8c88d2522da9f2c73b Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeTestJSON-402514228-project Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.299627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'eac7cea8-b1f2-4104-bb3b-083dcacbf502'} Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:06:31.300766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. Aug 01 17:06:31.302763 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:06:31.304176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] Returning 404 to user: Instance eac7cea8-b1f2-4104-bb3b-083dcacbf502 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:06:31.304176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c3063771-f839-41e2-8772-498a1d97e487 tempest-AttachVolumeTestJSON-402514228 tempest-AttachVolumeTestJSON-402514228-project] 10.222.0.20 "GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502" status: 404 len: 111 microversion: 2.1 time: 0.033123 Aug 01 17:06:31.304176 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 483/975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:31 2022] GET /compute/v2.1/servers/eac7cea8-b1f2-4104-bb3b-083dcacbf502 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:31.673810 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:31.674467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:31.683399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.683856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.684632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:31.685067 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:31.902804 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:31.912855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2570e5cc-4fb5-4429-a589-cdccf6ee0332 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.243648 Aug 01 17:06:31.913437 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 493/976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:31 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:32.934198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:32.934978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:32.938530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:32.944264 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:32.945055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:32.945941 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:32.946516 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:33.091405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:33.098876 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0fe90b15-b4e1-4952-94bc-326dafb2590e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.168581 Aug 01 17:06:33.100610 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 484/977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:32 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:33.628521 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-b216bb84-856c-42b5-8ff9-2eaa889d1e3f req-ee789476-cbf4-473e-93eb-9568ec760eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0", "name": "network-vif-plugged", "status": "completed", "tag": "46e5e004-b44c-4010-9e82-75cec9d67ff5"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:33.639706 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-b216bb84-856c-42b5-8ff9-2eaa889d1e3f req-ee789476-cbf4-473e-93eb-9568ec760eb0 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:33.640153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-b216bb84-856c-42b5-8ff9-2eaa889d1e3f req-ee789476-cbf4-473e-93eb-9568ec760eb0 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:33.651966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-b216bb84-856c-42b5-8ff9-2eaa889d1e3f req-ee789476-cbf4-473e-93eb-9568ec760eb0 service nova] Creating event network-vif-plugged:46e5e004-b44c-4010-9e82-75cec9d67ff5 for instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 on hv-cinder-84989 Aug 01 17:06:33.657018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-b216bb84-856c-42b5-8ff9-2eaa889d1e3f req-ee789476-cbf4-473e-93eb-9568ec760eb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 Aug 01 17:06:33.657603 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 494/978] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:34.119893 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:34.120501 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:34.126961 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:34.127407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:34.128166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:34.128599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:34.291657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:34.301018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42cf7ea3-3a8b-4c21-b87f-a22895c20947 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.184844 Aug 01 17:06:34.302376 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 485/979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:34 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:35.323028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:35.323851 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:35.330975 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:35.331434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:35.332784 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:35.333813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:35.473922 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:35.482943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ceba3711-bce2-4c50-8f4e-f65909624923 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1367 microversion: 2.1 time: 0.164061 Aug 01 17:06:35.483859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 495/980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:35 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:36.505244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:36.505936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:36.515034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:36.515034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:36.515034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:36.515034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:36.649254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:06:36.656721 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-27a97c5d-26cd-4a9f-a671-a55983854000 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1556 microversion: 2.1 time: 0.155974 Aug 01 17:06:36.657306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 486/981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:06:36 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:36.682663 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:36.683192 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:06:36.689177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:36.689624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:36.690405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:36.690842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:36.769037 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ef2fbd6d-96f1-48f7-add4-92fef0f23b79 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090452 Aug 01 17:06:36.776588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 496/982] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:06:36 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:37.783118 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-63bd7c9c-9c51-419d-990c-b567284fb296 req-ba2e8e12-3c15-4139-98b1-b5b6db21214b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0", "tag": "46e5e004-b44c-4010-9e82-75cec9d67ff5"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:06:37.793092 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-63bd7c9c-9c51-419d-990c-b567284fb296 req-ba2e8e12-3c15-4139-98b1-b5b6db21214b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:06:37.793534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-63bd7c9c-9c51-419d-990c-b567284fb296 req-ba2e8e12-3c15-4139-98b1-b5b6db21214b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:06:37.806070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-63bd7c9c-9c51-419d-990c-b567284fb296 req-ba2e8e12-3c15-4139-98b1-b5b6db21214b service nova] Creating event network-changed:46e5e004-b44c-4010-9e82-75cec9d67ff5 for instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 on hv-cinder-84989 Aug 01 17:06:37.809851 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-63bd7c9c-9c51-419d-990c-b567284fb296 req-ba2e8e12-3c15-4139-98b1-b5b6db21214b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030465 Aug 01 17:06:37.810485 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 487/983] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:38.649113 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0f953d85-c647-439a-b35b-572cae7d06f3 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733da92ee0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:38.710280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0f953d85-c647-439a-b35b-572cae7d06f3 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/049d22b6-7864-44d9-bc2f-b8364b5f8148" status: 200 len: 351 microversion: 2.1 time: 0.065606 Aug 01 17:06:38.711098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 497/984] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:06:38 2022] GET /compute/v2.1/os-volumes/049d22b6-7864-44d9-bc2f-b8364b5f8148 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:40.327234 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-eaf53ee6-f99d-4d97-b072-8d2122135b72 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733dce24c0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:40.374668 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-eaf53ee6-f99d-4d97-b072-8d2122135b72 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1ef7a7-7036-4bd2-a68c-e7089150b948" status: 200 len: 350 microversion: 2.1 time: 0.052478 Aug 01 17:06:40.375239 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 488/985] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:06:40 2022] GET /compute/v2.1/os-volumes/cb1ef7a7-7036-4bd2-a68c-e7089150b948 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:41.862596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-051f7ecc-ad19-4029-b7f2-2f842ddaad21 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733db25ca0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:41.910062 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-051f7ecc-ad19-4029-b7f2-2f842ddaad21 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4af98a18-8ed5-4f59-b4bf-41654f3d122e" status: 200 len: 350 microversion: 2.1 time: 0.051797 Aug 01 17:06:41.910647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 498/986] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:06:41 2022] GET /compute/v2.1/os-volumes/4af98a18-8ed5-4f59-b4bf-41654f3d122e => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:41.923468 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8c35e32a-cded-4d84-8adf-8535b64ce8fd tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f73402c5ca0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.007621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8c35e32a-cded-4d84-8adf-8535b64ce8fd tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088375 Aug 01 17:06:42.008196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 489/987] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 1 17:06:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:42.021382 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e79a43a4-3555-47cc-8348-0915e5d0e1be tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733dab7b80>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.103613 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e79a43a4-3555-47cc-8348-0915e5d0e1be tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085914 Aug 01 17:06:42.104182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 499/988] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:42.118152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a7f2f358-e75a-404c-99d7-c00b9d48533c tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733f6e9af0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.204503 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a7f2f358-e75a-404c-99d7-c00b9d48533c tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091040 Aug 01 17:06:42.205074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 490/989] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:42.217912 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-07f02ce4-ba01-4d75-9357-78f4e46c73a3 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733db61f70>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.299844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-07f02ce4-ba01-4d75-9357-78f4e46c73a3 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085689 Aug 01 17:06:42.300418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 500/990] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:42.313826 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-514d21bc-2e73-41d9-9da4-91f058b82083 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733d875c10>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.395188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-514d21bc-2e73-41d9-9da4-91f058b82083 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085061 Aug 01 17:06:42.395877 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 491/991] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:42.408578 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-429b522f-59d2-48e1-b90b-41c894bee50f tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733da92280>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.491315 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-429b522f-59d2-48e1-b90b-41c894bee50f tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086418 Aug 01 17:06:42.491915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 501/992] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:06:42.504853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0783a013-b8f2-4ce5-9aff-55c86833be51 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733d8b5700>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.586361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0783a013-b8f2-4ce5-9aff-55c86833be51 tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085343 Aug 01 17:06:42.586936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 492/993] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:06:42.600487 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3d00e02a-2ceb-4ca4-b233-a571ecabbf2b tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] Calling method '.version_select at 0x7f733db25ee0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:06:42.683529 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3d00e02a-2ceb-4ca4-b233-a571ecabbf2b tempest-VolumesTestJSON-411172262 tempest-VolumesTestJSON-411172262-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087393 Aug 01 17:06:42.684093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 502/994] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 1 17:06:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:07:10.343210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=13 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:10.343972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=26 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:10.348151 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:10.350821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:10.358963 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.359429 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.360217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.361113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.393751 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4c12fc36-e330-4a91-a842-7a67174663d0 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052171 Aug 01 17:07:10.394369 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 493/995] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 1 17:07:10 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:07:10.459632 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=13 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:10.460479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=19 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:10.464527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:10.465028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:10.471074 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.471611 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.472419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.472856 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.499225 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:07:10.763686 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5a00b258-8a0a-41a9-bfe5-f7b0d2fe6352 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 204 len: 0 microversion: 2.20 time: 0.305127 Aug 01 17:07:10.764403 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 503/996] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 1 17:07:10 2022] DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 17:07:10.779546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:10.780167 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:10.787088 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.787749 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.789076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:10.790474 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:10.959661 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:10.968025 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:10.969516 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:10.970708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-914beaad-067a-4507-bdc9-7c512fce1a41 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.197769 Aug 01 17:07:10.971255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 494/997] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:10 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:07:11.995758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:11.996559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:12.003273 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:12.003712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:12.004505 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:12.004926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:12.142719 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:12.151375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:12.152941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:12.154056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0f8125d7-d569-4a64-8bb4-9528f006683f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1725 microversion: 2.20 time: 0.163338 Aug 01 17:07:12.154789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 504/998] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:11 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 17:07:13.182200 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:13.182918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:13.190174 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:13.190929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:13.191858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:13.192365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:13.269958 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:13.297124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-7b9c0b7c-fa5a-4d10-abd8-4aeb7f3adbe0 req-7a68ecb1-c2bf-4a81-8ee7-0d61a69528ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1e758f-9380-400c-95ca-fc87c1d2fd53", "name": "network-vif-deleted", "tag": "a2374c82-5748-4b13-ae7f-5520f92fea69"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:07:13.305271 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:13.306865 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48cc0715e7b04f8a8c9f0d8c455bd4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc1c3badb144d24a2b86341a155505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:07:13.308056 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b09d4203-96c8-4bf6-8ee9-0b4b50e5aa13 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 200 len: 1657 microversion: 2.20 time: 0.133970 Aug 01 17:07:13.308616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 495/999] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:13 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 1657 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 17:07:13.315447 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-7b9c0b7c-fa5a-4d10-abd8-4aeb7f3adbe0 req-7a68ecb1-c2bf-4a81-8ee7-0d61a69528ce service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:13.316156 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-7b9c0b7c-fa5a-4d10-abd8-4aeb7f3adbe0 req-7a68ecb1-c2bf-4a81-8ee7-0d61a69528ce service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:13.328530 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-7b9c0b7c-fa5a-4d10-abd8-4aeb7f3adbe0 req-7a68ecb1-c2bf-4a81-8ee7-0d61a69528ce service nova] Creating event network-vif-deleted:a2374c82-5748-4b13-ae7f-5520f92fea69 for instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 on hv-cinder-84989 Aug 01 17:07:13.334335 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-7b9c0b7c-fa5a-4d10-abd8-4aeb7f3adbe0 req-7a68ecb1-c2bf-4a81-8ee7-0d61a69528ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040662 Aug 01 17:07:13.336065 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 505/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:07:14.332438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:14.333009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:14.340365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:14.340818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:14.341589 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:14.342185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:14.365516 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 HTTP/1.1 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:14.367618 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:14.369102 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'ec1e758f-9380-400c-95ca-fc87c1d2fd53'} Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:14.370008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:14.371424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:14.372857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:14.373194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6737d764-c676-48e0-ad06-43842eacf055 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 404 len: 111 microversion: 2.20 time: 0.044766 Aug 01 17:07:14.373899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 496/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:14 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:14.384247 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-67a24985-0aba-4429-8d99-b72d15cf97df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '.version_select at 0x7f733db0c160>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:14.456325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-67a24985-0aba-4429-8d99-b72d15cf97df tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000802603" status: 204 len: 0 microversion: 2.20 time: 0.077870 Aug 01 17:07:14.456899 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 506/1002] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Aug 1 17:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000802603 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 17:07:16.478024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:16.478532 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:16.485132 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:16.485541 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:16.486347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:16.486790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:16.500678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 HTTP/1.1 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:16.502293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.504047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'ec1e758f-9380-400c-95ca-fc87c1d2fd53'} Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:16.505265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.507037 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.508820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:16.508820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fbd16315-ecea-40ef-9ec3-a7ae42d431bc tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 404 len: 111 microversion: 2.20 time: 0.030596 Aug 01 17:07:16.508820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 497/1003] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 1 17:07:16 2022] DELETE /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:16.512999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:16.513740 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: ec1e758f-9380-400c-95ca-fc87c1d2fd53] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:16.520476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:16.521207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:16.522344 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:16.523452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:16.536469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 HTTP/1.1 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:07:16.538216 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.540366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'ec1e758f-9380-400c-95ca-fc87c1d2fd53'} Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:16.541380 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. Aug 01 17:07:16.542952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:16.544643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance ec1e758f-9380-400c-95ca-fc87c1d2fd53 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:16.544643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c837b622-f066-4b08-a1df-67c604127e67 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53" status: 404 len: 111 microversion: 2.20 time: 0.031747 Aug 01 17:07:16.544643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 507/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:16 2022] GET /compute/v2.1/servers/ec1e758f-9380-400c-95ca-fc87c1d2fd53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:17.855337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:17.855897 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:17.862402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:17.862850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:17.863898 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:17.864335 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:17.879168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d HTTP/1.1 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:17.880722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.882813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '2afc4567-0ddd-4f00-b501-0ee07c12677d'} Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:17.883678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.884942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.887285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:17.887285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-26f180c8-407b-43fc-9ac6-a8563d876d4f tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 404 len: 111 microversion: 2.20 time: 0.031098 Aug 01 17:07:17.887285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 498/1005] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 1 17:07:17 2022] DELETE /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:17.891540 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:17.892158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] [instance: 2afc4567-0ddd-4f00-b501-0ee07c12677d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:07:17.899101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:17.899555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:17.900369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:07:17.900815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:07:17.914978 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] HTTP exception thrown: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Request method failure captured: Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d HTTP/1.1 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AXcMt24V-4Epi7h7gWQl6_SzRYQ4gcZ8OCG1-_GYR6C-WiqxojZOmLneTmVama4NL9PUlblkDAYKcZrkk6WVElNLwlrzXHedslwik0j8bEQRLWl_5tld7vXD8QSjH2kdqSU7IFHmEnGo5P8mElSWsU1zpgzb9HgoUttw3_Y1shRN2g Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:07:17.916562 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfc1c3badb144d24a2b86341a155505a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: dfc1c3badb144d24a2b86341a155505a Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-433494255 Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 48cc0715e7b04f8a8c9f0d8c455bd4c6 Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-433494255-project Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.918255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '2afc4567-0ddd-4f00-b501-0ee07c12677d'} Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:17.919162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. Aug 01 17:07:17.920644 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:17.921939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] Returning 404 to user: Instance 2afc4567-0ddd-4f00-b501-0ee07c12677d could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:17.921939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-60aeffdb-90d3-4424-8d78-1c0ef773c8b4 tempest-AttachVolumeShelveTestJSON-433494255 tempest-AttachVolumeShelveTestJSON-433494255-project] 10.222.0.20 "GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d" status: 404 len: 111 microversion: 2.20 time: 0.030395 Aug 01 17:07:17.921939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 508/1006] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 1 17:07:17 2022] GET /compute/v2.1/servers/2afc4567-0ddd-4f00-b501-0ee07c12677d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:24.024811 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-610db35e-3606-439a-a0a4-a49355c949ba tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Action: 'create', calling method: .version_select at 0x7f733d846e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1109228653", "metadata": {"Type": "work"}}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-610db35e-3606-439a-a0a4-a49355c949ba tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 122 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:24.043740 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1109228653", "metadata": {"Type": "work"}}} Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: Aug 01 17:07:24.046783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1109228653', 'metadata': {'Type': 'work'}}}} Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise error Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.047885 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 17:07:24.049593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 17:07:24.051097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 17:07:24.051097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.051097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-610db35e-3606-439a-a0a4-a49355c949ba tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.051097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-610db35e-3606-439a-a0a4-a49355c949ba tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137721 Aug 01 17:07:24.051097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 499/1007] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 1 17:07:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:24.056524 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2333daa-20cf-417e-b690-9c0e74cf8558 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Action: 'create', calling method: .version_select at 0x7f733dbfa820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588488013", "metadata": {"Type": "work"}}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2333daa-20cf-417e-b690-9c0e74cf8558 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 120 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:07:24.061275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588488013", "metadata": {"Type": "work"}}} Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 17:07:24.062797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1588488013', 'metadata': {'Type': 'work'}}}} Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise error Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi '0' Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.063909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 17:07:24.065584 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 17:07:24.068919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 17:07:24.068919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.068919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2333daa-20cf-417e-b690-9c0e74cf8558 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.068919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d2333daa-20cf-417e-b690-9c0e74cf8558 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010646 Aug 01 17:07:24.068919 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 509/1008] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 1 17:07:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:24.076476 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aec31555-8ff5-48f7-9095-b426ce3641f2 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Action: 'create', calling method: .version_select at 0x7f733d97cf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-356552900", "metadata": {"Type": "work"}}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aec31555-8ff5-48f7-9095-b426ce3641f2 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 118 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:24.081116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-356552900", "metadata": {"Type": "work"}}} Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: Aug 01 17:07:24.083012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-356552900', 'metadata': {'Type': 'work'}}}} Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise error Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi '' Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.084407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 17:07:24.095245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 17:07:24.097008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 17:07:24.097008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.097008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aec31555-8ff5-48f7-9095-b426ce3641f2 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.097008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-aec31555-8ff5-48f7-9095-b426ce3641f2 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010214 Aug 01 17:07:24.097008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 500/1009] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 1 17:07:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:07:24.097516 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2eac60ed-f414-4b28-b6fc-1b52a8fb2fbc tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Calling method '.version_select at 0x7f733db0c160>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:24.133360 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-2eac60ed-f414-4b28-b6fc-1b52a8fb2fbc tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] HTTP exception thrown: Volume tempest-invalid-744042639 could not be found. Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2eac60ed-f414-4b28-b6fc-1b52a8fb2fbc tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-744042639 HTTP/1.1 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:07:24.135556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume tempest-invalid-744042639 could not be found. Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'tempest-invalid-744042639'} Aug 01 17:07:24.137123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-744042639 could not be found. (HTTP 404) (Request-ID: req-4ea1780c-745f-4ee1-b129-d2358626ca1d) Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.138434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 17:07:24.140119 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-744042639 could not be found. Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:24.141755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-744042639 could not be found. Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-744042639 could not be found. Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2eac60ed-f414-4b28-b6fc-1b52a8fb2fbc tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 404 to user: Volume tempest-invalid-744042639 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2eac60ed-f414-4b28-b6fc-1b52a8fb2fbc tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-744042639" status: 404 len: 98 microversion: 2.1 time: 0.047600 Aug 01 17:07:24.154367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 510/1010] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Aug 1 17:07:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-744042639 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 17:07:24.155542 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b80e6b32-6e5d-46c9-9306-40b73138dcce tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004616 Aug 01 17:07:24.155542 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 501/1011] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 1 17:07:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 17:07:24.157847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6a2cd3cd-52b0-4efa-a16f-888cab73483b tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003754 Aug 01 17:07:24.158367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 511/1012] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 1 17:07:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 01 17:07:24.167553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-449e5825-7446-4934-baa5-c42595a08bcb tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Calling method '.version_select at 0x7f733e674040>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:24.195557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-449e5825-7446-4934-baa5-c42595a08bcb tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] HTTP exception thrown: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-449e5825-7446-4934-baa5-c42595a08bcb tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/os-volumes/3cf9dad6-9e9e-4a69-a033-2deb9f008957 HTTP/1.1 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:07:24.205539 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '3cf9dad6-9e9e-4a69-a033-2deb9f008957'} Aug 01 17:07:24.207090 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. (HTTP 404) (Request-ID: req-549ee07a-a9c7-4ec4-a26b-423e4d0f6f2b) Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.207954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 17:07:24.209160 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 17:07:24.211046 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-449e5825-7446-4934-baa5-c42595a08bcb tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 404 to user: Volume 3cf9dad6-9e9e-4a69-a033-2deb9f008957 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-449e5825-7446-4934-baa5-c42595a08bcb tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3cf9dad6-9e9e-4a69-a033-2deb9f008957" status: 404 len: 109 microversion: 2.1 time: 0.036086 Aug 01 17:07:24.212257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 502/1013] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:07:24 2022] DELETE /compute/v2.1/os-volumes/3cf9dad6-9e9e-4a69-a033-2deb9f008957 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:07:24.213166 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-417515f4-efc3-49ac-9ac2-4fd02e8ab1a1 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Calling method '.version_select at 0x7f733d96f0d0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:07:24.237463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-417515f4-efc3-49ac-9ac2-4fd02e8ab1a1 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] HTTP exception thrown: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-417515f4-efc3-49ac-9ac2-4fd02e8ab1a1 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Request method failure captured: Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/os-volumes/7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f HTTP/1.1 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AhLvKbOzkxfn3wIzD8aUcqmccUxCP3okF7AuZJMecYl97D42VLJZ58Wagrw7G0-9Q9DQ53Yi1e3WUf-9khyANh2ulkg0AccZeFeWrF5E6Kn6xf-_PgGo0crnUzxJsHO-MGCKsOVkVOIQFrgLiTN_bycjTUec90dnDyvviPzOruitz4 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:07:24.239710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72831c952b8a4ede9f305c94c597a4fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 72831c952b8a4ede9f305c94c597a4fc Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesNegativeTest-336379553 Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: d283bc9875454ebbad389e12fa19a3c1 Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesNegativeTest-336379553-project Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f'} Aug 01 17:07:24.241731 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. (HTTP 404) (Request-ID: req-1fdcada3-4c1b-424c-9940-52d10fb031a3) Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.242927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 17:07:24.244460 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 17:07:24.246093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-417515f4-efc3-49ac-9ac2-4fd02e8ab1a1 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] Returning 404 to user: Volume 7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-417515f4-efc3-49ac-9ac2-4fd02e8ab1a1 tempest-VolumesNegativeTest-336379553 tempest-VolumesNegativeTest-336379553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f" status: 404 len: 109 microversion: 2.1 time: 0.036472 Aug 01 17:07:24.247533 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 512/1014] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:07:24 2022] GET /compute/v2.1/os-volumes/7f9dd40c-1db7-46d4-8e44-b3fbbe5c6b8f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:08:04.530488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=12 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:04.531243 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=24 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:04.536105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:04.540114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:04.542513 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.542964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.543728 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.544166 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.568635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c78ce0fb-4180-40da-bc97-069bfd0a5aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/ips" status: 200 len: 148 microversion: 2.1 time: 0.039357 Aug 01 17:08:04.569212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 503/1015] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:08:04 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:04.579643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:04.580400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:04.584553 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5e47f18-1e9b-4b3d-af32-0d7651f3e83c"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:04.586905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:04.592943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.593389 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.594314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.594753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.680363 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: POST /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/os-volume_attachments HTTP/1.1 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 74 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:08:04.683648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {"volumeAttachment": {"volumeId": "a5e47f18-1e9b-4b3d-af32-0d7651f3e83c"}} Aug 01 17:08:04.685432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'server_id': 'c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0', 'body': {'volumeAttachment': {'volumeId': 'a5e47f18-1e9b-4b3d-af32-0d7651f3e83c'}}} Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:08:04.686518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:04.688538 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 400 to user: Invalid volume: volume a5e47f18-1e9b-4b3d-af32-0d7651f3e83c is already attached to instances: 51df7577-f191-4c2b-aaf4-d69c0d759f28 {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d148ed51-4fa9-40ba-a083-843242d82af8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105975 Aug 01 17:08:04.690207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 513/1016] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:08:04 2022] POST /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:08:04.692789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:04.693290 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:04.699665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.700143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.700906 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:04.701342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:04.726706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:08:05.048497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42928dc2-eb0b-4e90-b083-20e8470b99c9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 204 len: 0 microversion: 2.1 time: 0.359437 Aug 01 17:08:05.049092 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 504/1017] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:08:04 2022] DELETE /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:08:05.057142 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:05.057766 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:05.065324 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:05.065777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:05.066586 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:05.067030 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:05.202911 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:05.211180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2b51883f-1173-48dd-805d-d0cfe598c476 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1680 microversion: 2.1 time: 0.157825 Aug 01 17:08:05.211746 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 514/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:05 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:06.233720 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:06.234911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:06.241607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:06.242441 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:06.243209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:06.243642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:06.374920 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:06.382387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4482a498-7021-4397-82b1-b13f0089483f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1680 microversion: 2.1 time: 0.152993 Aug 01 17:08:06.382955 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 505/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:06 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:07.402907 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:07.403673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:07.410368 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:07.415018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:07.415018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:07.415018 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:07.540498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:07.548532 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6191a0b9-1266-464c-89b0-2853fd0164f9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1680 microversion: 2.1 time: 0.149507 Aug 01 17:08:07.549098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 515/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:07 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:08.569447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:08.570075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:08.577744 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:08.579061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:08.580029 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:08.580641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:08.647622 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:08.655156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4761f72c-1bed-4ad7-84ee-2934a56a010a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1612 microversion: 2.1 time: 0.089636 Aug 01 17:08:08.655708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 506/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:08 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:08.859881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-80cdbf46-3547-4404-8420-97767f2a92a4 req-27b341ca-4719-4cf1-9c0f-c46784a5bc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0", "name": "network-vif-deleted", "tag": "46e5e004-b44c-4010-9e82-75cec9d67ff5"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:08.870181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-80cdbf46-3547-4404-8420-97767f2a92a4 req-27b341ca-4719-4cf1-9c0f-c46784a5bc83 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:08.870626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-80cdbf46-3547-4404-8420-97767f2a92a4 req-27b341ca-4719-4cf1-9c0f-c46784a5bc83 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:08.882453 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-80cdbf46-3547-4404-8420-97767f2a92a4 req-27b341ca-4719-4cf1-9c0f-c46784a5bc83 service nova] Creating event network-vif-deleted:46e5e004-b44c-4010-9e82-75cec9d67ff5 for instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 on hv-cinder-84989 Aug 01 17:08:08.887752 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-80cdbf46-3547-4404-8420-97767f2a92a4 req-27b341ca-4719-4cf1-9c0f-c46784a5bc83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031649 Aug 01 17:08:08.888336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 516/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:09.676395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:09.677238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:09.684365 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:09.684814 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:09.685605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:09.686055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:09.750797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:09.758450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-261e32c6-7e26-412c-bc57-e4e5886d2394 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1612 microversion: 2.1 time: 0.085936 Aug 01 17:08:09.759111 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 507/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:09 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:10.781839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:10.782547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:10.788942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:10.793153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:10.793153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:10.793153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:10.859046 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:10.868436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7d9d33c7-a019-4bf7-9f1f-48becbc3aee0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1612 microversion: 2.1 time: 0.091885 Aug 01 17:08:10.869009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 517/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:10 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:11.889889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:11.891204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:11.897784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:11.898260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:11.899038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:11.899481 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:11.964521 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:11.971945 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c9faa8f3-5500-4946-9c9b-07377d277a9a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1326 microversion: 2.1 time: 0.085953 Aug 01 17:08:11.972515 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 508/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:11 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:12.993829 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:12.994472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:13.001517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:13.001968 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:13.002762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:13.003209 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:13.033195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:13.033647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:13.034131 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'fault' on Instance uuid c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:08:13.080833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:13.084971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6521257f-9d60-4619-9750-7a49d1ea3d72 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 200 len: 1331 microversion: 2.1 time: 0.095024 Aug 01 17:08:13.085552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 518/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:12 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:14.106358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:14.106919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:14.113873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:14.114354 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:14.117017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:14.117017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:14.129538 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 HTTP/1.1 Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:08:14.131275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:08:14.132846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0'} Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:08:14.133649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:08:14.135038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:14.136229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:08:14.136229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7464bc62-d7e8-4c01-9712-7a29993a958d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 404 len: 111 microversion: 2.1 time: 0.030587 Aug 01 17:08:14.136229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 509/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:14 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:08:14.142336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fb6a0141-0b26-49f8-9c3b-e9aa0cf3877a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '.version_select at 0x7f733d96f550>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:14.202572 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fb6a0141-0b26-49f8-9c3b-e9aa0cf3877a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442004950" status: 202 len: 0 microversion: 2.1 time: 0.064769 Aug 01 17:08:14.203494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 519/1028] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 1 17:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442004950 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:08:15.039367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:15.047399 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:15.048439 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:15.048983 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:15.049846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:15.050384 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:15.139766 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'services' on Instance uuid 51df7577-f191-4c2b-aaf4-d69c0d759f28 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:08:15.321972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a58caad0-69d6-46a6-abf6-85985519e754 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments/a5e47f18-1e9b-4b3d-af32-0d7651f3e83c" status: 202 len: 0 microversion: 2.1 time: 0.287260 Aug 01 17:08:15.322645 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 510/1029] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:08:15 2022] DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments/a5e47f18-1e9b-4b3d-af32-0d7651f3e83c => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:08:15.332128 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:15.334343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:15.341048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:15.341501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:15.342298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:15.342845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:15.375507 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-38899a8e-2e13-4ceb-ae9c-f2b8fcb0c703 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048188 Aug 01 17:08:15.376094 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 520/1030] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:08:15 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:16.387702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:16.390128 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:16.397579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:16.398020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:16.398807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:16.399241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:16.431359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2656003a-ea95-4021-b072-b002e3ad1256 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Aug 01 17:08:16.431839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 511/1031] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:08:16 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:17.444454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:17.446660 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:17.453019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.459756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.459756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.459756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.482624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d68666c5-43f1-4d2a-b044-22f4f99acf7f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042866 Aug 01 17:08:17.483183 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 521/1032] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:08:17 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:08:17.552010 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:17.552642 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:17.559096 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.559542 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.560309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.560746 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.585140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:08:17.796559 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c8473a4a-df4a-40c8-8af6-a63ed766b2db tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 204 len: 0 microversion: 2.1 time: 0.248785 Aug 01 17:08:17.797156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 512/1033] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:08:17 2022] DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:08:17.805936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:17.806580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:17.812520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.812970 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.813781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:17.814375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:17.946486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:17.954165 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-22096de2-133d-417d-b629-f5fd751089fa tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1681 microversion: 2.1 time: 0.152082 Aug 01 17:08:17.954923 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 522/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:17 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:18.976971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:18.977736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:18.984130 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:18.984567 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:18.985356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:18.986401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:19.115433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:19.123103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-10ec0f29-b215-4e53-aa7d-7fc84ab9c706 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1681 microversion: 2.1 time: 0.150376 Aug 01 17:08:19.123670 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 513/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:18 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:20.144589 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:20.145200 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:20.152497 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:20.152957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:20.153723 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:20.154184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:20.287648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:20.295068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dd503390-bf62-4cf6-9eab-fd1c4ef8b6ac tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1681 microversion: 2.1 time: 0.154395 Aug 01 17:08:20.295634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 523/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:20 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:21.316808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:21.317422 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:21.324147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:21.324595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:21.325357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:21.325796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:21.458309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:21.465646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-91ef1049-03bf-4e45-ac82-14a005052ca4 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1681 microversion: 2.1 time: 0.153333 Aug 01 17:08:21.466241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 514/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:21 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:22.487612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:22.488157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:22.494677 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:22.495124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:22.495888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:22.496325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:22.626670 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:22.634127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cc444ead-981e-4c29-957a-0ce29b317a67 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1681 microversion: 2.1 time: 0.150822 Aug 01 17:08:22.634693 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 524/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:22 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:23.639925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-d6011039-2945-42e6-ae1c-76d2fb798f46 req-85193172-9264-44e9-9fa1-42d373669e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51df7577-f191-4c2b-aaf4-d69c0d759f28", "name": "network-vif-deleted", "tag": "1f6310e3-403c-4493-a502-419db6a0cd7b"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:23.652592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d6011039-2945-42e6-ae1c-76d2fb798f46 req-85193172-9264-44e9-9fa1-42d373669e19 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:23.653294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d6011039-2945-42e6-ae1c-76d2fb798f46 req-85193172-9264-44e9-9fa1-42d373669e19 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:23.658397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:23.659134 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:23.666258 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-d6011039-2945-42e6-ae1c-76d2fb798f46 req-85193172-9264-44e9-9fa1-42d373669e19 service nova] Creating event network-vif-deleted:1f6310e3-403c-4493-a502-419db6a0cd7b for instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 on hv-cinder-84989 Aug 01 17:08:23.667288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:23.669387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:23.670634 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:23.671298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:23.674185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-d6011039-2945-42e6-ae1c-76d2fb798f46 req-85193172-9264-44e9-9fa1-42d373669e19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Aug 01 17:08:23.678002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 515/1039] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:23.766787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:23.775365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b95b31f8-8801-439d-aa73-d2297792f141 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 200 len: 1613 microversion: 2.1 time: 0.123217 Aug 01 17:08:23.776303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 525/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:23 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:08:24.800575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:24.801273 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:24.807910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:24.808358 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:24.809113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:24.809546 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:24.825254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 HTTP/1.1 Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:08:24.827097 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:08:24.829020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '51df7577-f191-4c2b-aaf4-d69c0d759f28'} Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:08:24.830649 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:08:24.832252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:08:24.833702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:08:24.833702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4bf33bb-b7c1-4eb7-ab65-cd8693fe6653 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 404 len: 111 microversion: 2.1 time: 0.033238 Aug 01 17:08:24.833702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 516/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:24 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:08:24.838256 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d7458921-a9aa-4d0b-a2b3-3558a50ec4d7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '.version_select at 0x7f733daa6040>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:24.942870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d7458921-a9aa-4d0b-a2b3-3558a50ec4d7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685272777" status: 202 len: 0 microversion: 2.1 time: 0.100838 Aug 01 17:08:24.942870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 526/1042] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 1 17:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685272777 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:08:25.696410 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: .version_select at 0x7f73402c5dc0>, body: {"keypair": {"name": "tempest-keypair-1210473219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdpVSATpF6jUx+yBDHQt9bUSBAxBPc+TNl58flLz31Z6bI2UsBxApuD/j5k6Nov1YfLmsYi8YBLbxIjgqfbEuK1FP/oRQSJGUCUlhcqGJqRZM0WWqC9MnFDYyFiNckCjw=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:25.712148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:08:25.715941 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:08:25.727730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [42cd1ccd-e518-444d-ac87-a598f3022fe5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 17:08:26.734878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [42cd1ccd-e518-444d-ac87-a598f3022fe5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54208. Aug 01 17:08:26.797188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-061badfc-cacb-476e-a745-ccb46776dee5 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.104752 Aug 01 17:08:26.797837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 517/1043] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:08:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:28.968618 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1289427218", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ade5d3a-dad9-4932-9ac9-db242643b6f5"}], "security_groups": [{"name": "tempest-securitygroup--336405014"}], "key_name": "tempest-keypair-1210473219", "user_data": "}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:29.080274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] validate_networks() for [('6ade5d3a-dad9-4932-9ac9-db242643b6f5', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:08:29.456157 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:08:29.456590 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:08:29.457104 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:08:29.457544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:08:29.457939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:08:29.466783 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:29.467236 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:29.468049 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:29.468488 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:29.485906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:08:29.491278 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:08:29.503355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:08:29.505650 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:08:29.621234 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bf81d1de-9a29-4094-b323-bd9cc05b266b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657189 Aug 01 17:08:29.622223 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 527/1044] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:08:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:08:29.634551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0580f64c-174c-4e1f-b458-5b59ce60f46d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:29.635285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0580f64c-174c-4e1f-b458-5b59ce60f46d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:29.695732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0580f64c-174c-4e1f-b458-5b59ce60f46d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:29.703778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0580f64c-174c-4e1f-b458-5b59ce60f46d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1242 microversion: 2.1 time: 0.073487 Aug 01 17:08:29.704973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 518/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:29 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:30.725500 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2393352c-fed1-4774-b89b-c9bb88838b62 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:30.726104 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2393352c-fed1-4774-b89b-c9bb88838b62 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:30.779079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2393352c-fed1-4774-b89b-c9bb88838b62 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:30.785791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2393352c-fed1-4774-b89b-c9bb88838b62 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1242 microversion: 2.1 time: 0.064807 Aug 01 17:08:30.786401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 528/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:30 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:08:31.806933 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:31.807548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:31.814796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:31.815360 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:31.816071 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:31.816525 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:31.883302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:31.886950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:31.891318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-83c0ad82-1fd8-4c15-9052-44f2871b4cde tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1246 microversion: 2.1 time: 0.088310 Aug 01 17:08:31.893389 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 519/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:31 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:32.914416 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:32.914815 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:32.921400 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:32.921852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:32.922662 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:32.923127 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:32.991060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:32.998694 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7d8e9e02-d3a3-4d9f-a08b-0f34cb1de033 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1246 microversion: 2.1 time: 0.089741 Aug 01 17:08:32.999272 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 529/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:32 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:34.019692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:34.020307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:34.027127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:34.027577 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:34.028346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:34.028784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:34.093031 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:34.100698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e09064c8-a885-4885-a8cb-cabca0028105 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1246 microversion: 2.1 time: 0.085230 Aug 01 17:08:34.101274 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 520/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:34 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:35.122106 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:35.122714 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:35.125334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:35.130607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:35.131053 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:35.131806 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:35.132235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:35.136076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=79 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:35.193352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:35.201154 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c235ab8c-b735-48ff-96ec-8cefefa94ef8 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1238 microversion: 2.1 time: 0.082943 Aug 01 17:08:35.205280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 530/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:35 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:36.223783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:36.224431 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:36.226853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:36.231860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:36.233250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:36.233250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:36.233497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:36.296753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:36.305108 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59a88c11-ab16-4822-9522-eaa530b92ec9 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1294 microversion: 2.1 time: 0.085826 Aug 01 17:08:36.305676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 521/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:36 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:37.325682 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:37.326389 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:37.335204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:37.336318 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:37.336687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:37.336833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:37.546107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:37.553689 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-83e825e4-a912-40e2-bd6c-42e950e8c4c2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.231923 Aug 01 17:08:37.554357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 531/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:37 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:38.195253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-8ef421a6-36e3-4469-86a5-79c718bdff4e req-fe7b3ec8-2c62-46ad-97d3-5f8271fa9e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1aac8dc-af95-4967-916b-14c0cf5ad32d", "tag": "515b32e0-f96b-43f8-86de-aec64b5a8113"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:38.205588 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8ef421a6-36e3-4469-86a5-79c718bdff4e req-fe7b3ec8-2c62-46ad-97d3-5f8271fa9e68 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:38.206088 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8ef421a6-36e3-4469-86a5-79c718bdff4e req-fe7b3ec8-2c62-46ad-97d3-5f8271fa9e68 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:38.217164 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-8ef421a6-36e3-4469-86a5-79c718bdff4e req-fe7b3ec8-2c62-46ad-97d3-5f8271fa9e68 service nova] Creating event network-changed:515b32e0-f96b-43f8-86de-aec64b5a8113 for instance c1aac8dc-af95-4967-916b-14c0cf5ad32d on hv-cinder-84989 Aug 01 17:08:38.223785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-8ef421a6-36e3-4469-86a5-79c718bdff4e req-fe7b3ec8-2c62-46ad-97d3-5f8271fa9e68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032506 Aug 01 17:08:38.224355 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 522/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:38.408449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:08:38.408615 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:08:38.575626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:38.576246 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:38.583288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:38.583743 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:38.584511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:38.584951 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:38.711008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:38.718419 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9c4bc8d6-0c10-4434-8a40-22698e7e4ee7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.146701 Aug 01 17:08:38.719011 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 532/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:38 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:39.741062 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:39.741866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:39.744619 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:39.749820 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:39.750308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:39.751178 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:39.752156 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:39.880799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:39.888136 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7fe5019c-e39c-482c-8f13-77b2db2bc8cc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.151767 Aug 01 17:08:39.888698 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 523/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:39 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:40.908824 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:40.909440 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:40.911358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:40.912485 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=8 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:40.917264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:40.917708 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:40.918506 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:40.918942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:41.047090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:41.055026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e5144715-e6fc-43b9-98db-5b9ac797f95e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.150148 Aug 01 17:08:41.055591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 533/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:40 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:42.076440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:42.077082 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:42.084864 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:42.085254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:42.086058 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:42.086554 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:42.237313 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:42.245917 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-13693b3b-3695-4566-a66a-6847e0cff31e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.173260 Aug 01 17:08:42.246568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 524/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:42 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:43.267050 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:43.267817 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:43.274351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:43.274794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:43.275552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:43.275980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:43.403539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:43.411479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a00191a0-7254-4c2e-a74c-f32aec0347af tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.148336 Aug 01 17:08:43.412050 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 534/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:43 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:44.432036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:44.432646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:44.439231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:44.439700 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:44.440496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:44.440931 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:44.567733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:44.575127 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-89bc2477-05d8-4c18-a023-2591c696fd2d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.146956 Aug 01 17:08:44.575690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 525/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:44 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:45.596778 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:45.597386 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:45.604031 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:45.604479 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:45.605237 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:45.605675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:45.733309 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:45.741786 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f7a45837-e7f8-49e5-8b59-a3a1e33ea392 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.149249 Aug 01 17:08:45.742366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 535/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:45 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:46.762061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:46.762714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:46.769338 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:46.769733 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:46.770524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:46.770973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:46.900275 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:46.908122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7908e057-5388-441f-ae92-64d35e2b724f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.149644 Aug 01 17:08:46.908774 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 526/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:46 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:47.928754 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:47.929368 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:47.935930 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:47.936381 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:47.937147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:47.937585 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:48.069054 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:48.076607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-aefb649d-17ee-4456-bd34-635236ec107d tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.151772 Aug 01 17:08:48.077153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 536/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:47 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:49.097792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:49.098444 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:49.105665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:49.106147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:49.106920 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:49.107346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:49.239287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:49.246730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ef7f4f03-a76f-4ffd-8a6e-55beb04bd2a3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.153006 Aug 01 17:08:49.247295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 527/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:49 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:50.266798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:50.267445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:50.273864 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:50.274337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:50.279794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:50.279794 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:50.404282 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:50.412367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-083f5d22-cb1c-4c6a-bbe6-d2a7afb2d8ec tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.149468 Aug 01 17:08:50.412934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 537/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:50 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:51.434173 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:51.434799 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:51.441254 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:51.441644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:51.442450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:51.447362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:51.571879 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:51.580122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3af24ddb-839e-408c-a76c-42323f44ee66 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.149392 Aug 01 17:08:51.580709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 528/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:51 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:51.667464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-48ee3621-8550-46c1-8f27-51447510560b req-81820ef1-0532-438a-8061-358470a20a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1aac8dc-af95-4967-916b-14c0cf5ad32d", "name": "network-vif-plugged", "status": "completed", "tag": "515b32e0-f96b-43f8-86de-aec64b5a8113"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:51.677514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-48ee3621-8550-46c1-8f27-51447510560b req-81820ef1-0532-438a-8061-358470a20a62 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:51.677952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-48ee3621-8550-46c1-8f27-51447510560b req-81820ef1-0532-438a-8061-358470a20a62 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:51.689196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-48ee3621-8550-46c1-8f27-51447510560b req-81820ef1-0532-438a-8061-358470a20a62 service nova] Creating event network-vif-plugged:515b32e0-f96b-43f8-86de-aec64b5a8113 for instance c1aac8dc-af95-4967-916b-14c0cf5ad32d on hv-cinder-84989 Aug 01 17:08:51.699105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-48ee3621-8550-46c1-8f27-51447510560b req-81820ef1-0532-438a-8061-358470a20a62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030968 Aug 01 17:08:51.699105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 538/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:52.601072 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:52.601684 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:52.608197 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:52.608693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:52.609448 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:52.609880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:52.743211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:52.750699 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c82a22ff-b7c8-4315-bc7b-6c5b2239de24 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.153603 Aug 01 17:08:52.751278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 529/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:52 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:53.773733 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:53.774467 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:53.780695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:53.781139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:53.781897 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:53.782352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:53.919443 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:53.928276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e7a63cb3-2973-4ebd-9957-7f4d679f80dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1367 microversion: 2.1 time: 0.159727 Aug 01 17:08:53.928852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 539/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:53 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:54.949964 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:54.950628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:54.957801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:54.958278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:54.959060 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:54.959495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:55.098344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:08:55.105996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6b0b116c-12bd-4827-91cb-e866d86aac60 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1556 microversion: 2.1 time: 0.159964 Aug 01 17:08:55.111158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 530/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:08:54 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:08:55.133023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:08:55.133023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:08:55.137167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:55.137791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:55.138609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:55.139048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:55.219390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e1632a89-00e5-4434-a6b6-e0a5d63e4848 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094665 Aug 01 17:08:55.224398 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 540/1070] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:08:55 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:08:56.267446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-f4031951-db03-4782-88f5-6c386b591a53 req-150d71bb-7449-4704-9054-91f2731d8434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1aac8dc-af95-4967-916b-14c0cf5ad32d", "tag": "515b32e0-f96b-43f8-86de-aec64b5a8113"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:08:56.277221 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f4031951-db03-4782-88f5-6c386b591a53 req-150d71bb-7449-4704-9054-91f2731d8434 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:08:56.277659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-f4031951-db03-4782-88f5-6c386b591a53 req-150d71bb-7449-4704-9054-91f2731d8434 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:08:56.289414 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-f4031951-db03-4782-88f5-6c386b591a53 req-150d71bb-7449-4704-9054-91f2731d8434 service nova] Creating event network-changed:515b32e0-f96b-43f8-86de-aec64b5a8113 for instance c1aac8dc-af95-4967-916b-14c0cf5ad32d on hv-cinder-84989 Aug 01 17:08:56.294569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-f4031951-db03-4782-88f5-6c386b591a53 req-150d71bb-7449-4704-9054-91f2731d8434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 Aug 01 17:08:56.296805 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 531/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:09:06.628019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=21 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:06.628924 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=59 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:06.828150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b7830da2-1a0b-4804-af18-40678c082681 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Action: 'create', calling method: .version_select at 0x7f733da92dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1131523973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLEBPZSrsBeEiciKk7cfwUUTMhtxdpUZ5NxFdc8+9oYkLWzsDOgsXyucskIlfkH24gk8QSjOwOFNkkjJcV6s4BzaBx6/5ycjKAYMfP4nfk/Maor1BNDAkXLQ5oYrV8M4g=="}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:09:06.845024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-b7830da2-1a0b-4804-af18-40678c082681 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for project c2cff009abd049a7aff67696680687ca. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:09:06.849375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-b7830da2-1a0b-4804-af18-40678c082681 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for user 8ca353ec7cb948c9a803e6422ea3476e and project c2cff009abd049a7aff67696680687ca. Resources: {'key_pairs'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:09:06.934378 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b7830da2-1a0b-4804-af18-40678c082681 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.307706 Aug 01 17:09:06.934944 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 541/1072] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:09:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:09:33.203635 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=21 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:33.204459 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=64 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:33.208564 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1057302496", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131523973", "security_groups": [{"name": "tempest-secgroup-smoke-2093562813"}], "block_device_mapping_v2": [{"uuid": "d8725901-2195-4b80-a9e5-dad4b5be9a09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:09:33.321094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] validate_networks() for [('c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:09:33.787185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:09:33.787606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:09:33.788074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:09:33.788475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:09:33.788883 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:09:33.798197 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:33.798637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:33.799426 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:33.799855 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:33.816199 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:09:33.820281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for user 8ca353ec7cb948c9a803e6422ea3476e and project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:09:33.876808 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:09:33.879069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8725901-2195-4b80-a9e5-dad4b5be9a09',volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:09:34.295116 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d13aee3b-bcef-4f0c-ac3c-9f0a47ac76d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093699 Aug 01 17:09:34.295818 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 532/1073] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:09:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:09:34.304060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=4 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:34.305383 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:34.309275 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-acf406f5-20a7-4414-851a-1519e27ea620 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:34.309881 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-acf406f5-20a7-4414-851a-1519e27ea620 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:34.364060 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-acf406f5-20a7-4414-851a-1519e27ea620 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:34.371994 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-acf406f5-20a7-4414-851a-1519e27ea620 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1095 microversion: 2.1 time: 0.069278 Aug 01 17:09:34.375266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 542/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:34 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:35.393070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:35.393684 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:35.400959 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:35.401411 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:35.402250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:35.402688 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:35.466557 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:35.473821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-77c069dc-257d-40d2-8116-63e1d9e87720 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1145 microversion: 2.1 time: 0.084858 Aug 01 17:09:35.474621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 533/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:35 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:36.498271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:36.498903 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:36.505207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:36.505657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:36.506483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:36.506926 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:36.571886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:36.579230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b53961ce-834f-4cbc-9c24-2871e832b432 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1211 microversion: 2.1 time: 0.086376 Aug 01 17:09:36.579797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 543/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:36 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:37.599628 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:37.600268 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:37.607905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:37.608347 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:37.609108 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:37.609604 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:37.750143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:37.757724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9c448db7-5136-4c5f-91d6-b2fb1962503e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.161991 Aug 01 17:09:37.758363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 534/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:37 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:37.931745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-9f4bdce6-aa8b-44dc-bf60-06845f317111 req-4bfbb46f-bdbd-4366-b4d6-e0cab7ae3094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c61f5e-abd6-4e49-aad2-d828f46bfc7b", "tag": "4e318430-72b3-4385-a705-92123b765477"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:09:37.941791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9f4bdce6-aa8b-44dc-bf60-06845f317111 req-4bfbb46f-bdbd-4366-b4d6-e0cab7ae3094 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:37.942268 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9f4bdce6-aa8b-44dc-bf60-06845f317111 req-4bfbb46f-bdbd-4366-b4d6-e0cab7ae3094 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:37.953397 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-9f4bdce6-aa8b-44dc-bf60-06845f317111 req-4bfbb46f-bdbd-4366-b4d6-e0cab7ae3094 service nova] Creating event network-changed:4e318430-72b3-4385-a705-92123b765477 for instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b on hv-cinder-84989 Aug 01 17:09:37.958404 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-9f4bdce6-aa8b-44dc-bf60-06845f317111 req-4bfbb46f-bdbd-4366-b4d6-e0cab7ae3094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030979 Aug 01 17:09:37.959000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 544/1078] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:09:38.779066 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:38.779686 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:38.786194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:38.786646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:38.787412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:38.787850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:38.917062 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:38.924543 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fd6347f4-4ded-4ee6-8b2b-e7125c87a9ef tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.149392 Aug 01 17:09:38.925113 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 535/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:38 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:39.947431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:39.948147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:39.954376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:39.954828 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:39.955623 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:39.956063 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:40.090109 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:40.093867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5bd6a730-f838-4214-8d8f-12aa8be92991 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.151946 Aug 01 17:09:40.094476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 545/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:39 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:41.114631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:41.115248 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:41.121793 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:41.122278 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:41.123054 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:41.123488 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:41.263392 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:41.270713 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cf93349f-8d8f-4917-acc9-86b23c3cb017 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.160256 Aug 01 17:09:41.271292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 536/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:41 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:42.293181 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:42.293788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:42.300512 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:42.300953 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:42.301712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:42.302167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:42.454319 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:42.462341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6f492e4-6c1a-4aeb-bd58-8e9ec4dbec08 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.173617 Aug 01 17:09:42.463461 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 546/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:42 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:43.486255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:43.486797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:43.493287 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:43.493761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:43.494634 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:43.495077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:43.625923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:43.633373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ef6edcea-5541-41fc-9233-ab8f6cab79d5 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.151506 Aug 01 17:09:43.633943 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 537/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:43 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:44.654418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:44.655030 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:44.657472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:44.662334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:44.662788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:44.663579 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:44.664015 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:44.796553 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:44.804052 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3dead685-3ad9-4b2b-b531-40048fc08a33 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.153538 Aug 01 17:09:44.804621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 547/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:44 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:45.825755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:45.826404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:45.828359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:45.829052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:45.834607 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:45.835061 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:45.835867 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:45.836285 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:45.970581 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:45.978137 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-76013072-1537-4805-a39e-b4716e4f5679 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.157023 Aug 01 17:09:45.979293 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 538/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:45 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:46.999362 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:46.999981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:47.006652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:47.007104 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:47.007870 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:47.008311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:47.139587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:47.147069 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b4e193d1-db86-4866-b8e2-8aa2d6bea0a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.151607 Aug 01 17:09:47.147636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 548/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:46 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:47.927208 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-40ef8bcf-d764-48e9-8fcd-bff35289f657 req-689ff531-cc10-40aa-a2e5-15786782b214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c61f5e-abd6-4e49-aad2-d828f46bfc7b", "name": "network-vif-plugged", "status": "completed", "tag": "4e318430-72b3-4385-a705-92123b765477"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:09:47.937681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-40ef8bcf-d764-48e9-8fcd-bff35289f657 req-689ff531-cc10-40aa-a2e5-15786782b214 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:47.938143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-40ef8bcf-d764-48e9-8fcd-bff35289f657 req-689ff531-cc10-40aa-a2e5-15786782b214 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:47.948872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-40ef8bcf-d764-48e9-8fcd-bff35289f657 req-689ff531-cc10-40aa-a2e5-15786782b214 service nova] Creating event network-vif-plugged:4e318430-72b3-4385-a705-92123b765477 for instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b on hv-cinder-84989 Aug 01 17:09:47.953789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-40ef8bcf-d764-48e9-8fcd-bff35289f657 req-689ff531-cc10-40aa-a2e5-15786782b214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Aug 01 17:09:47.954396 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 539/1087] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:09:48.168626 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:48.169185 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:48.175868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:48.176314 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:48.177123 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:48.177552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:48.357162 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:48.364904 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f5be665d-f7fe-4ef4-9201-6225e82552b9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.200948 Aug 01 17:09:48.365485 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 549/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:48 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:49.387417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:49.388120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:49.394846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:49.395305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:49.396142 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:49.396584 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:49.534819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:49.543013 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf22b646-84d6-4e2e-b555-fdb694851a19 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1267 microversion: 2.1 time: 0.161041 Aug 01 17:09:49.544999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 540/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:49 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:50.564657 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:50.565273 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:50.571770 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:50.572844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:50.573707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:50.574179 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:50.708316 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:50.716180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-fdd0ebf9-4f41-4dc3-be60-f8ed4acbf7f3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1454 microversion: 2.1 time: 0.155361 Aug 01 17:09:50.717075 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 550/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:50 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:50.736238 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:09:50.736853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:09:50.743270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:50.743714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:50.744975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:50.745398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:50.875158 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:09:50.882712 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-515b54df-291e-4daf-ac99-12626ef9cb6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1454 microversion: 2.1 time: 0.150640 Aug 01 17:09:50.883381 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 541/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:09:50 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:09:53.019707 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-533fc6df-81a6-4a21-bb70-56738971fe27 req-cde0a10e-26bc-419a-860e-a179fa9b586d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c61f5e-abd6-4e49-aad2-d828f46bfc7b", "tag": "4e318430-72b3-4385-a705-92123b765477"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:09:53.030304 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-533fc6df-81a6-4a21-bb70-56738971fe27 req-cde0a10e-26bc-419a-860e-a179fa9b586d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:09:53.030753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-533fc6df-81a6-4a21-bb70-56738971fe27 req-cde0a10e-26bc-419a-860e-a179fa9b586d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:09:53.042633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-533fc6df-81a6-4a21-bb70-56738971fe27 req-cde0a10e-26bc-419a-860e-a179fa9b586d service nova] Creating event network-changed:4e318430-72b3-4385-a705-92123b765477 for instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b on hv-cinder-84989 Aug 01 17:09:53.047857 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-533fc6df-81a6-4a21-bb70-56738971fe27 req-cde0a10e-26bc-419a-860e-a179fa9b586d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031928 Aug 01 17:09:53.048612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 551/1092] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:14.847069 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:14.847842 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=52 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:14.953305 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:14.953806 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:14.959879 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:14.960334 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:14.961126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:14.961567 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:14.985367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-edf105b4-2977-4994-90ed-bcd3cccf9e08 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/ips" status: 200 len: 148 microversion: 2.1 time: 0.143297 Aug 01 17:10:14.986211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 542/1093] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:10:14 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/ips => generated 148 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:16.559173 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295fd291-9f9f-40b0-9cc5-592800f3b97d"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:16.561797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:16.563961 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=22 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:16.564607 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=46 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:16.569513 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:16.569966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:16.570756 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:16.571195 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:17.311816 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ad5bc68c-c0f7-42a6-b668-d511c4658a68 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757607 Aug 01 17:10:17.312426 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 552/1094] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:10:16 2022] POST /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:24.826290 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295fd291-9f9f-40b0-9cc5-592800f3b97d"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:24.828682 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:24.834798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:24.835244 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:24.835991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:24.836419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:24.968204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments HTTP/1.1 Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 74 Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:10:24.969866 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {"volumeAttachment": {"volumeId": "295fd291-9f9f-40b0-9cc5-592800f3b97d"}} Aug 01 17:10:24.971726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'server_id': 'c1aac8dc-af95-4967-916b-14c0cf5ad32d', 'body': {'volumeAttachment': {'volumeId': '295fd291-9f9f-40b0-9cc5-592800f3b97d'}}} Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:24.972692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:24.974319 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 400 to user: Invalid volume: volume 295fd291-9f9f-40b0-9cc5-592800f3b97d is already attached to instances: c1aac8dc-af95-4967-916b-14c0cf5ad32d {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2e33bd95-fbb7-46af-8dff-3965da2edc17 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149158 Aug 01 17:10:24.975932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 543/1095] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:10:24 2022] POST /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments => generated 174 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 17:10:25.036986 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:25.037577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:25.044402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:25.050580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:25.050580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:25.050580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:25.126928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'services' on Instance uuid c1aac8dc-af95-4967-916b-14c0cf5ad32d {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:10:25.283903 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a94915a8-9654-4ef4-ba85-5a8ac9311858 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments/295fd291-9f9f-40b0-9cc5-592800f3b97d" status: 202 len: 0 microversion: 2.1 time: 0.251395 Aug 01 17:10:25.284555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 553/1096] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:10:25 2022] DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments/295fd291-9f9f-40b0-9cc5-592800f3b97d => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:10:25.292912 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:25.295180 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:25.302126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:25.302561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:25.303326 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:25.303773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:25.333745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2476cc27-209a-4295-a1ef-258b8d09ccd2 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 01 17:10:25.334344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 544/1097] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:10:25 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:26.348105 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:26.350478 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:26.356880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.357369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.358208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.358651 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.387264 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-346f0924-076b-469e-a2ba-724f42ff8c03 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043981 Aug 01 17:10:26.387854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 554/1098] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:10:26 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:10:26.449991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:26.450518 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:26.457726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.458210 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.459100 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.459534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.484764 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:10:26.782309 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-88587457-7f7f-4ba9-9455-8f91d9b2e777 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 204 len: 0 microversion: 2.1 time: 0.335748 Aug 01 17:10:26.782972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 545/1099] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:10:26 2022] DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:10:26.791024 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:26.791643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:26.797836 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.798346 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.799111 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:26.799553 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:26.967525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:26.967525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-bb48dbdc-d722-4b8f-8fe1-49ec5380ad12 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1680 microversion: 2.1 time: 0.164079 Aug 01 17:10:26.967525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 555/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:26 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:27.979714 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:27.980419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:27.987734 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:27.988179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:27.988936 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:27.989371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:28.121927 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:28.130241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ebc562f6-5cce-4e8a-a295-789c1b29de34 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1680 microversion: 2.1 time: 0.154628 Aug 01 17:10:28.130845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 546/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:27 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:29.152182 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:29.152823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:29.159527 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:29.159999 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:29.160797 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:29.161230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:29.336967 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:29.344558 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-795bba18-e887-4be7-83ea-3fae9d1d8217 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1680 microversion: 2.1 time: 0.196273 Aug 01 17:10:29.345132 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 556/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:29 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:29.714853 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-75ef970c-6850-4455-9e86-9973ba77a897 req-930ff9df-07b3-4f9f-845d-898a3d889d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1aac8dc-af95-4967-916b-14c0cf5ad32d", "name": "network-vif-deleted", "tag": "515b32e0-f96b-43f8-86de-aec64b5a8113"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:29.725297 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-75ef970c-6850-4455-9e86-9973ba77a897 req-930ff9df-07b3-4f9f-845d-898a3d889d2c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:29.726021 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-75ef970c-6850-4455-9e86-9973ba77a897 req-930ff9df-07b3-4f9f-845d-898a3d889d2c service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:29.740231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-75ef970c-6850-4455-9e86-9973ba77a897 req-930ff9df-07b3-4f9f-845d-898a3d889d2c service nova] Creating event network-vif-deleted:515b32e0-f96b-43f8-86de-aec64b5a8113 for instance c1aac8dc-af95-4967-916b-14c0cf5ad32d on hv-cinder-84989 Aug 01 17:10:29.745186 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-75ef970c-6850-4455-9e86-9973ba77a897 req-930ff9df-07b3-4f9f-845d-898a3d889d2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Aug 01 17:10:29.745821 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 547/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:30.366960 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:30.367576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:30.374349 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:30.374869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:30.375662 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:30.376101 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:30.411654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:30.412520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:30.412700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'fault' on Instance uuid c1aac8dc-af95-4967-916b-14c0cf5ad32d {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:10:30.454750 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:30.462399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4c805d68-1e9d-42f7-abe8-0f5436884a29 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 200 len: 1332 microversion: 2.1 time: 0.099333 Aug 01 17:10:30.464576 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 557/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:30 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:10:31.484664 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:31.485621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:31.491783 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:31.492211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:31.492974 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:31.493405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:31.507044 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d HTTP/1.1 Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:10:31.508650 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:10:31.510419 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'c1aac8dc-af95-4967-916b-14c0cf5ad32d'} Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:10:31.511558 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:10:31.513195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:10:31.515606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:10:31.515606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-11b67aad-de20-4000-8cd5-4499b51a9782 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 404 len: 111 microversion: 2.1 time: 0.030209 Aug 01 17:10:31.515606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 548/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:31 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:10:31.519408 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3e22abe0-3680-4d49-9d8b-0100dfcf078b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '.version_select at 0x7f733dbf1a60>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:31.612068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3e22abe0-3680-4d49-9d8b-0100dfcf078b tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210473219" status: 202 len: 0 microversion: 2.1 time: 0.096359 Aug 01 17:10:31.612643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 558/1106] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 1 17:10:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210473219 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:10:32.542860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f712518d-c04c-4f29-b933-9e786f4c2d4c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: .version_select at 0x7f733dc7ac10>, body: {"keypair": {"name": "tempest-keypair-273330012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvCwUaw6qocmW1vd46+a1O/GPuZvsp/bWN4wnegaR7k+nBJ3y4FLgjbju2HAzzBQU6o0xn7QfZhcXiRtPCEFiYwPbpcE6Qg+EfdwOVbEJuXWsHmFm82HTNGMJhCTlhJ5A=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:32.558646 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-f712518d-c04c-4f29-b933-9e786f4c2d4c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:10:32.562647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-f712518d-c04c-4f29-b933-9e786f4c2d4c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:10:32.623195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f712518d-c04c-4f29-b933-9e786f4c2d4c tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084223 Aug 01 17:10:32.623809 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 549/1107] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 1 17:10:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:34.645628 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094218978", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ade5d3a-dad9-4932-9ac9-db242643b6f5"}], "security_groups": [{"name": "tempest-securitygroup--1542505248"}], "key_name": "tempest-keypair-273330012", "user_data": "}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:34.748160 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] validate_networks() for [('6ade5d3a-dad9-4932-9ac9-db242643b6f5', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:10:35.116100 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:10:35.116531 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:10:35.117009 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:10:35.117423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:10:35.117836 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:10:35.126978 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:35.127429 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:35.128233 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:35.128676 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:35.145675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:10:35.149681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Getting quotas for user f3484bf0457a407d954de53bf9bc8a91 and project 29aa58f150be4722ad251dad9a7f1a7e. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:10:35.161241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:10:35.163539 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:10:35.269638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b06c5eaa-45fd-48a5-aeaa-ae8cb58db827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.628687 Aug 01 17:10:35.270315 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 559/1108] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:10:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:10:35.281910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42d82143-5411-4b61-83ac-30ee449c46c3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:35.282910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42d82143-5411-4b61-83ac-30ee449c46c3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:35.338428 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42d82143-5411-4b61-83ac-30ee449c46c3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:35.345857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42d82143-5411-4b61-83ac-30ee449c46c3 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1241 microversion: 2.1 time: 0.068664 Aug 01 17:10:35.346469 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 550/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:35 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:36.366751 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:36.367452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:36.374782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:36.375748 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:36.376510 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:36.376939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:36.438649 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:36.446463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d6eae97a-328e-48ae-bda7-6a3469b6ca2e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1237 microversion: 2.1 time: 0.083702 Aug 01 17:10:36.447038 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 560/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:36 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:37.467967 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:37.468613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:37.475170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:37.475616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:37.476426 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:37.476858 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:37.543202 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:37.550784 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfbb7985-1725-4f0c-8ab8-7b4f8269083e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1299 microversion: 2.1 time: 0.086995 Aug 01 17:10:37.551326 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 551/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:37 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:38.572098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:38.572802 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:38.579937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:38.589428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:38.589428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:38.589428 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:38.699954 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-cb909039-2d89-4456-9036-6074eb1371c1 req-5524b73b-0857-4a5d-9d81-6d390149092b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f517dd65-11d5-45d5-a741-67845faf52ce", "tag": "ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:38.710536 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-cb909039-2d89-4456-9036-6074eb1371c1 req-5524b73b-0857-4a5d-9d81-6d390149092b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:38.710985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-cb909039-2d89-4456-9036-6074eb1371c1 req-5524b73b-0857-4a5d-9d81-6d390149092b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:38.722106 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-cb909039-2d89-4456-9036-6074eb1371c1 req-5524b73b-0857-4a5d-9d81-6d390149092b service nova] Creating event network-changed:ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9 for instance f517dd65-11d5-45d5-a741-67845faf52ce on hv-cinder-84989 Aug 01 17:10:38.727141 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-cb909039-2d89-4456-9036-6074eb1371c1 req-5524b73b-0857-4a5d-9d81-6d390149092b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Aug 01 17:10:38.727922 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 552/1112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:10:38.783269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:38.790789 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-56ef8667-e30c-4c9c-891a-b014227493d1 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.222506 Aug 01 17:10:38.791372 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 561/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:38 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:39.814334 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:39.815032 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:39.822004 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:39.822478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:39.823229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:39.823659 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:39.951317 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:39.958825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4c59868c-77cf-4e93-8e07-4d8c36f2f382 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.149285 Aug 01 17:10:39.959383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 553/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:39 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:40.979637 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:40.980255 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:40.987158 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:40.987608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:40.988371 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:40.988809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:41.120799 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:41.128241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4d29c8fb-1af6-4d6d-8739-2e6db30da0d6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.152472 Aug 01 17:10:41.128813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:40 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:42.148775 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:42.149498 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:42.156189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:42.156644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:42.157504 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:42.157869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:42.313306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:42.320979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dece53e2-17f0-41e1-b3c1-93a3adc3bea0 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.176116 Aug 01 17:10:42.322900 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 554/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:42 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:43.343791 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:43.344401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:43.350916 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:43.351361 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:43.352121 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:43.352554 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:43.480355 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:43.488852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8bab53d0-6299-407b-90ed-449a13c99552 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.148926 Aug 01 17:10:43.489425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 563/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:43 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:44.173992 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-59be1d53-7b94-4842-86f6-b69b44921a3c req-62abef0f-c0d5-4f1c-afd7-188941812703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f517dd65-11d5-45d5-a741-67845faf52ce", "name": "network-vif-plugged", "status": "completed", "tag": "ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:44.183839 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-59be1d53-7b94-4842-86f6-b69b44921a3c req-62abef0f-c0d5-4f1c-afd7-188941812703 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:44.184281 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-59be1d53-7b94-4842-86f6-b69b44921a3c req-62abef0f-c0d5-4f1c-afd7-188941812703 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:44.195658 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-59be1d53-7b94-4842-86f6-b69b44921a3c req-62abef0f-c0d5-4f1c-afd7-188941812703 service nova] Creating event network-vif-plugged:ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9 for instance f517dd65-11d5-45d5-a741-67845faf52ce on hv-cinder-84989 Aug 01 17:10:44.200595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-59be1d53-7b94-4842-86f6-b69b44921a3c req-62abef0f-c0d5-4f1c-afd7-188941812703 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 Aug 01 17:10:44.201175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 555/1118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:44.510333 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:44.510945 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:44.518053 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:44.518528 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:44.519303 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:44.519745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:44.647348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:44.655051 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5012cd61-8056-4c1a-8f1d-e9ede2080d02 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.148706 Aug 01 17:10:44.655610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:44 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:45.674761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:45.678797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:45.679519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:45.681276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:45.686316 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:45.686761 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:45.687560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:45.687988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:45.691981 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:45.825427 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:45.833691 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6076f86b-eeb0-4eb8-a29e-187408666aba tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1367 microversion: 2.1 time: 0.160491 Aug 01 17:10:45.834352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 556/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:45 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:10:46.854668 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:46.855276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:46.857249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.857902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.859547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.864639 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:46.865074 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:46.866457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:46.866457 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:46.868900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.999799 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:10:47.007095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5b01da2d-4112-44e2-972c-aca22553f295 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1556 microversion: 2.1 time: 0.156375 Aug 01 17:10:47.007656 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 565/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:10:46 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:10:47.027707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:10:47.028241 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:10:47.035367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:47.035813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:47.036623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:47.037057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:47.113563 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-32c479b5-0ff8-4d1d-b030-2f14a3bb100f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090007 Aug 01 17:10:47.114220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 557/1122] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 1 17:10:47 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:10:48.182745 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-b05c25ae-7e46-4dbe-a48f-98a3acf67a8b req-1bb7020b-7c99-40fe-adf9-796642dec7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f517dd65-11d5-45d5-a741-67845faf52ce", "tag": "ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:10:48.192839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-b05c25ae-7e46-4dbe-a48f-98a3acf67a8b req-1bb7020b-7c99-40fe-adf9-796642dec7bb service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:10:48.193367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-b05c25ae-7e46-4dbe-a48f-98a3acf67a8b req-1bb7020b-7c99-40fe-adf9-796642dec7bb service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:10:48.205486 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-b05c25ae-7e46-4dbe-a48f-98a3acf67a8b req-1bb7020b-7c99-40fe-adf9-796642dec7bb service nova] Creating event network-changed:ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9 for instance f517dd65-11d5-45d5-a741-67845faf52ce on hv-cinder-84989 Aug 01 17:10:48.211073 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-b05c25ae-7e46-4dbe-a48f-98a3acf67a8b req-1bb7020b-7c99-40fe-adf9-796642dec7bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089305 Aug 01 17:10:48.211855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 566/1123] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:11:58.416748 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:11:58.417364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:11:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:12:03.117405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:03.118229 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=9 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:03.122407 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:03.122935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:03.128871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:03.140535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:03.140535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:03.140535 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:03.154015 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4b3d62d4-b091-4ad0-aaae-14293ad2b8eb tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/ips" status: 200 len: 149 microversion: 2.1 time: 0.038518 Aug 01 17:12:03.154620 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 558/1124] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:12:03 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:04.692892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:04.694351 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=7 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:04.699048 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2463d8e-e451-4adb-9976-f6c54f29a90c"}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:04.701425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:04.707436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:04.707868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:04.708648 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:04.709831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:05.314798 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-977d318c-02ac-45bc-aaa5-6a3535b11713 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "POST /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623729 Aug 01 17:12:05.315757 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 567/1125] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 1 17:12:04 2022] POST /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:10.662394 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:10.663502 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:10.670739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:10.671193 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:10.671950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:10.672383 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:10.697857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:12:10.928509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-26a8fcbc-923c-4f3d-bed8-5129fbf4e469 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 204 len: 0 microversion: 2.1 time: 0.270057 Aug 01 17:12:10.929935 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 559/1126] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:10 2022] DELETE /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:12:10.938514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:10.939222 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:10.946068 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:10.946523 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:10.947283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:10.947720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:11.078661 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:11.086617 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-846fa6ad-58a5-42a1-8199-e461d77adf5d tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1578 microversion: 2.1 time: 0.152272 Aug 01 17:12:11.087186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 568/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:10 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:12:12.108227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:12.109190 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:12.115665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:12.116603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:12.117366 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:12.117798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:12.252665 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:12.260386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c254d67f-5e9f-4dc0-98f3-c8f4eea5b3af tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1578 microversion: 2.1 time: 0.156470 Aug 01 17:12:12.264813 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:12 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:13.281981 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:13.282591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:13.289256 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:13.289777 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:13.290573 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:13.291226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:13.531984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:13.531984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-869df175-35bd-4ce1-b3ed-50fda4aa83aa tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1578 microversion: 2.1 time: 0.249375 Aug 01 17:12:13.531984 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 569/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:13 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:13.998527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:13.999151 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:14.005962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.006466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.007527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.007962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.090828 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'services' on Instance uuid f517dd65-11d5-45d5-a741-67845faf52ce {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:12:14.271736 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5ea77a2c-5eb3-4c22-b82e-933cdebc6363 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments/e2463d8e-e451-4adb-9976-f6c54f29a90c" status: 202 len: 0 microversion: 2.1 time: 0.276837 Aug 01 17:12:14.273103 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 561/1130] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 1 17:12:13 2022] DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments/e2463d8e-e451-4adb-9976-f6c54f29a90c => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:12:14.281605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:14.283971 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:14.291231 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.291712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.292425 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.292863 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.322250 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-512db79b-80f5-4a39-9ad4-32c4158f6f1a tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Aug 01 17:12:14.322826 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 570/1131] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:12:14 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:14.502896 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-e0d70d2f-28e4-4401-b92d-1c7556fa0716 req-e9ea096d-4aff-4006-a990-ce015af289b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c61f5e-abd6-4e49-aad2-d828f46bfc7b", "name": "network-vif-deleted", "tag": "4e318430-72b3-4385-a705-92123b765477"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:14.513918 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e0d70d2f-28e4-4401-b92d-1c7556fa0716 req-e9ea096d-4aff-4006-a990-ce015af289b7 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.514395 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e0d70d2f-28e4-4401-b92d-1c7556fa0716 req-e9ea096d-4aff-4006-a990-ce015af289b7 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.528023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-e0d70d2f-28e4-4401-b92d-1c7556fa0716 req-e9ea096d-4aff-4006-a990-ce015af289b7 service nova] Creating event network-vif-deleted:4e318430-72b3-4385-a705-92123b765477 for instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b on hv-cinder-84989 Aug 01 17:12:14.533550 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-e0d70d2f-28e4-4401-b92d-1c7556fa0716 req-e9ea096d-4aff-4006-a990-ce015af289b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093797 Aug 01 17:12:14.534357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 562/1132] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:14.548352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:14.549311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:14.556373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.556901 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.557747 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:14.558295 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:14.628384 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:14.636795 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b0cce23a-175e-41a8-8c4b-b6a46bfe1e75 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1510 microversion: 2.1 time: 0.092361 Aug 01 17:12:14.637652 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 571/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:14 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:15.337569 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:15.341810 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:15.352762 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:15.353473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:15.354330 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:15.354773 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:15.393299 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6917f941-412f-4a57-9a45-3efe4ecbe4c7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061051 Aug 01 17:12:15.394185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 563/1134] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:12:15 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:15.658300 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:15.658921 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:15.665568 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:15.666021 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:15.666813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:15.667254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:15.700579 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:15.701025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:15.701475 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lazy-loading 'fault' on Instance uuid 39c61f5e-abd6-4e49-aad2-d828f46bfc7b {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:12:15.743017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:15.750761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2a4ac932-de3b-4029-86e8-f5e1d4372204 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 200 len: 1231 microversion: 2.1 time: 0.096378 Aug 01 17:12:15.751334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 572/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:15 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:16.405979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:16.408165 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:16.415404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.415859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.416621 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.417057 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.444933 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-608d0522-6e57-45a6-b151-9647069a4c73 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042789 Aug 01 17:12:16.445489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 564/1136] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 1 17:12:16 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 17:12:16.505749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:16.506283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:16.512449 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.513044 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.513808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.514269 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.539911 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:12:16.773314 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:16.774055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:16.780079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.780522 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.781279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.781709 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.796666 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] HTTP exception thrown: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Request method failure captured: Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b HTTP/1.1 Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AisdjTPMvhPzEgV9VP0mmxBfQEdsIOetDPGdjesNdgxckRua1PutPcC8yf1oN8Jk4HnvFY7ii67AUT8PDzqWCDd9OdYhmqMfEIxJKHdXEyEScWrmctkf2szvZB8wcSi4cEuZcJzc3Dai8VzjhRMtmlFPrWdNWnnZEPijAes7_GU1Xw Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:16.797889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2cff009abd049a7aff67696680687ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2cff009abd049a7aff67696680687ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 8ca353ec7cb948c9a803e6422ea3476e Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:12:16.801553 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '39c61f5e-abd6-4e49-aad2-d828f46bfc7b'} Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:16.802671 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:12:16.804454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:16.806170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Returning 404 to user: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:16.806170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-06544bfe-bf8f-4406-a1e8-af83aa0a9c7b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 01 17:12:16.806170 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 565/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:16 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:12:16.848198 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e1de95ed-d607-4837-9beb-8494d4afd4bf tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 204 len: 0 microversion: 2.1 time: 0.346000 Aug 01 17:12:16.848715 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1867237432", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131523973", "security_groups": [{"name": "tempest-secgroup-smoke-2093562813"}], "block_device_mapping_v2": [{"uuid": "d8725901-2195-4b80-a9e5-dad4b5be9a09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:16.848859 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 573/1138] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:16 2022] DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:12:16.862150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:16.862934 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:16.869591 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.870272 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.871384 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:16.871843 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:16.964942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] validate_networks() for [('c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:12:17.007612 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:17.015214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-7bd05562-33ec-48e3-8089-454c98574459 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1681 microversion: 2.1 time: 0.157520 Aug 01 17:12:17.015788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 574/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:16 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:12:17.327878 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:12:17.328310 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:12:17.328785 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:12:17.329196 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:12:17.329611 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:12:17.339265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:17.339731 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:17.340532 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:17.341001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:17.357915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:12:17.362152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for user 8ca353ec7cb948c9a803e6422ea3476e and project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:12:17.418076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:12:17.420187 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8725901-2195-4b80-a9e5-dad4b5be9a09',volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:12:17.851560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-71c7c358-33e3-4f32-99c5-8e450aa2dec7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.006775 Aug 01 17:12:17.852255 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 566/1140] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:12:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 17:12:17.863463 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2e57fb76-4412-4fab-a483-81945acaab44 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:17.863982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2e57fb76-4412-4fab-a483-81945acaab44 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:17.919183 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2e57fb76-4412-4fab-a483-81945acaab44 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:17.925812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2e57fb76-4412-4fab-a483-81945acaab44 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1095 microversion: 2.1 time: 0.066325 Aug 01 17:12:17.926418 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 575/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:17 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:18.036777 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:18.037402 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:18.045307 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:18.045755 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:18.046561 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:18.046999 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:18.182318 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:18.189988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-32e53255-acd0-4534-ae8d-c1f5e4609022 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1681 microversion: 2.1 time: 0.157052 Aug 01 17:12:18.190623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 567/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:18 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:18.947879 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:18.948546 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:18.955872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:18.966107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:18.966107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:18.966107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:19.041788 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:19.049252 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-af9a4ef8-e69b-49ae-9cc4-fc5c39e54507 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1145 microversion: 2.1 time: 0.106213 Aug 01 17:12:19.050112 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 576/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:18 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:19.212534 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:19.221495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:19.221495 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:19.222418 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:19.223075 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:19.223548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:19.288367 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:19.296152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-90d30409-81b6-4aee-83c1-96b1e48841fe tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1613 microversion: 2.1 time: 0.088727 Aug 01 17:12:19.296777 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 568/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:19 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:19.469823 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-9e32138e-d62c-4551-acde-5071fef84fb6 req-1a430d98-f41b-40d4-abf8-87040baf34f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f517dd65-11d5-45d5-a741-67845faf52ce", "name": "network-vif-deleted", "tag": "ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:19.481243 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9e32138e-d62c-4551-acde-5071fef84fb6 req-1a430d98-f41b-40d4-abf8-87040baf34f6 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:19.482118 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9e32138e-d62c-4551-acde-5071fef84fb6 req-1a430d98-f41b-40d4-abf8-87040baf34f6 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:19.494965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-9e32138e-d62c-4551-acde-5071fef84fb6 req-1a430d98-f41b-40d4-abf8-87040baf34f6 service nova] Creating event network-vif-deleted:ec6d48d4-dbfa-4f25-b9ff-c8f9a0c5acd9 for instance f517dd65-11d5-45d5-a741-67845faf52ce on hv-cinder-84989 Aug 01 17:12:19.500219 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-9e32138e-d62c-4551-acde-5071fef84fb6 req-1a430d98-f41b-40d4-abf8-87040baf34f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Aug 01 17:12:19.500833 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 577/1145] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:20.072088 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:20.072829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:20.079342 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:20.079942 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:20.080891 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:20.081494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:20.169825 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:20.178379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7d9953e7-2b3c-4bbd-9d70-eaa141738c5a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1211 microversion: 2.1 time: 0.111333 Aug 01 17:12:20.180034 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 569/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:20 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:20.319028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:20.320311 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:20.331782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:20.331782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:20.331782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:20.331782 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:20.373891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:20.374390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:20.374845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lazy-loading 'fault' on Instance uuid f517dd65-11d5-45d5-a741-67845faf52ce {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:12:20.419958 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3484bf0457a407d954de53bf9bc8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29aa58f150be4722ad251dad9a7f1a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:20.427898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d36bf350-b649-4c25-beb3-29fc9f394742 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 200 len: 1331 microversion: 2.1 time: 0.113076 Aug 01 17:12:20.429139 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 578/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:20 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:21.202012 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:21.202690 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:21.217944 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:21.218423 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:21.219232 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:21.219683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:21.357344 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:21.365653 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-004b09dd-923e-42cf-99d1-dae677196893 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.167477 Aug 01 17:12:21.366432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 570/1148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:21 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:21.449277 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:21.449892 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:21.456571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:21.457019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:21.457814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:21.458267 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:21.471941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce HTTP/1.1 Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:12:21.473654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:21.476925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'f517dd65-11d5-45d5-a741-67845faf52ce'} Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:21.477965 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:21.479566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:21.481214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:21.481214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d7c4993c-04b4-4013-9679-f22a089f0cda tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 404 len: 111 microversion: 2.1 time: 0.029697 Aug 01 17:12:21.481214 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 579/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:21 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:21.484372 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6b715462-1a94-4af7-a485-c5bf273e0f85 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '.version_select at 0x7f733dcbe1f0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:21.527781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-442c1003-40fb-4be9-a75e-4adea645c070 req-a7521e80-84d0-4d13-9a71-ee3ca8b29c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f17911-8e13-4327-808a-1b859ef0ccd9", "tag": "915f91a8-1aa3-431a-b1c8-2cd151733fac"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:21.537245 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-442c1003-40fb-4be9-a75e-4adea645c070 req-a7521e80-84d0-4d13-9a71-ee3ca8b29c8a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:21.537695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-442c1003-40fb-4be9-a75e-4adea645c070 req-a7521e80-84d0-4d13-9a71-ee3ca8b29c8a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:21.548996 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-442c1003-40fb-4be9-a75e-4adea645c070 req-a7521e80-84d0-4d13-9a71-ee3ca8b29c8a service nova] Creating event network-changed:915f91a8-1aa3-431a-b1c8-2cd151733fac for instance 06f17911-8e13-4327-808a-1b859ef0ccd9 on hv-cinder-84989 Aug 01 17:12:21.554596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-442c1003-40fb-4be9-a75e-4adea645c070 req-a7521e80-84d0-4d13-9a71-ee3ca8b29c8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029817 Aug 01 17:12:21.555357 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 580/1150] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:12:21.558616 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6b715462-1a94-4af7-a485-c5bf273e0f85 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273330012" status: 202 len: 0 microversion: 2.1 time: 0.078472 Aug 01 17:12:21.559227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 571/1151] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 1 17:12:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273330012 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:12:22.387738 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:22.388508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:22.394853 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:22.395307 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:22.396071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:22.396514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:22.535109 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:22.543501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-11a7f9ee-2f8b-41eb-a0e2-5771ccbeb184 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.159993 Aug 01 17:12:22.544082 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 581/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:22 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:23.515357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:23.515947 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:23.521905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.522433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.523203 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.523639 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.537197 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce HTTP/1.1 Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:23.539265 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.540909 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'f517dd65-11d5-45d5-a741-67845faf52ce'} Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:23.541859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.543373 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.545191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:23.545191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7e1bb749-56d6-4d39-a6ad-e8e5e677a4f6 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 404 len: 111 microversion: 2.1 time: 0.029688 Aug 01 17:12:23.545191 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 572/1153] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:23 2022] DELETE /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:23.549108 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:23.549725 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: f517dd65-11d5-45d5-a741-67845faf52ce] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:23.557007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.557487 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.558274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.558716 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.563480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:23.564095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:23.570008 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.570485 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.571245 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:23.571677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:23.573415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce HTTP/1.1 Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:12:23.575080 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.576514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'f517dd65-11d5-45d5-a741-67845faf52ce'} Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:23.577423 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. Aug 01 17:12:23.579008 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:23.580496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance f517dd65-11d5-45d5-a741-67845faf52ce could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:23.580496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-54367d18-233e-40df-b554-2789d0b3225e tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce" status: 404 len: 111 microversion: 2.1 time: 0.031290 Aug 01 17:12:23.580496 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 582/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:23 2022] GET /compute/v2.1/servers/f517dd65-11d5-45d5-a741-67845faf52ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:23.709963 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:23.717491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a5cbae2-5270-4d97-8007-21c0a381834c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.157713 Aug 01 17:12:23.718073 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 573/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:23 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:12:24.738929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:24.739547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:24.746600 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.747045 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.747808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.748240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.766763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:24.832496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:24.832496 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:24.839149 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.839641 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.840382 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.840803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.854182 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d HTTP/1.1 Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:24.855732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.857475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'c1aac8dc-af95-4967-916b-14c0cf5ad32d'} Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:24.858599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.859868 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.861413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:24.861413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ded88be-9cc4-400c-a826-020d83a6c3e7 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 404 len: 111 microversion: 2.1 time: 0.029197 Aug 01 17:12:24.861413 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 574/1156] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:24 2022] DELETE /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:12:24.865971 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:24.866601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c1aac8dc-af95-4967-916b-14c0cf5ad32d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:24.873171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.873613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.875083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.875083 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.885184 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:24.890147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d HTTP/1.1 Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:24.891816 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.896873 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'c1aac8dc-af95-4967-916b-14c0cf5ad32d'} Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:24.897792 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. Aug 01 17:12:24.899840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.901262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c1aac8dc-af95-4967-916b-14c0cf5ad32d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:24.901356 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cb326819-9335-4dfc-8c7a-e8ec51afb0f4 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.157896 Aug 01 17:12:24.901454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f9b7d835-b372-4ca2-84af-e7bd4f80ea07 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d" status: 404 len: 111 microversion: 2.1 time: 0.030859 Aug 01 17:12:24.901555 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 583/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:24 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:24.901655 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 575/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:24 2022] GET /compute/v2.1/servers/c1aac8dc-af95-4967-916b-14c0cf5ad32d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:24.908204 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:24.908807 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:24.915636 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.916095 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.917002 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.917434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.931235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: DELETE /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 HTTP/1.1 Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:12:24.932760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.934441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0'} Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:24.935328 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.936702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.938056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:24.938056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cf23d4f6-bb88-4192-b0e5-1da9cc6192dc tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 404 len: 111 microversion: 2.1 time: 0.030560 Aug 01 17:12:24.938056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 584/1159] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:24 2022] DELETE /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 17:12:24.942753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:24.943379 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:24.949823 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.950484 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.951701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:24.952147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:24.966453 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 HTTP/1.1 Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:24.967977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.969432 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': 'c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0'} Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:24.970219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. Aug 01 17:12:24.971677 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:24.972803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:24.972803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-111cd3bb-fa92-4cb4-958c-56ae54bbe448 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0" status: 404 len: 111 microversion: 2.1 time: 0.030561 Aug 01 17:12:24.972803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 576/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:24 2022] GET /compute/v2.1/servers/c93ebf7f-43e4-4d27-8a30-fa40c5dc5cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:25.916203 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:25.916820 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:25.923431 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:25.923883 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:25.924642 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:25.925077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:26.057083 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:26.064494 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-70622793-96ff-4a67-b9ab-c9c51399dd34 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.152956 Aug 01 17:12:26.065057 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 585/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:25 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:26.242594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:26.243105 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:26.249681 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:26.250195 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:26.251018 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:26.251447 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:26.264916 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 HTTP/1.1 Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:12:26.266524 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.268201 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '51df7577-f191-4c2b-aaf4-d69c0d759f28'} Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:26.269038 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.270398 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.271745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:26.271745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d691d365-2824-4a31-b102-7535a7b2c827 tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 404 len: 111 microversion: 2.1 time: 0.029277 Aug 01 17:12:26.271745 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 577/1162] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:12:26 2022] DELETE /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:26.277268 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:26.277888 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] [instance: 51df7577-f191-4c2b-aaf4-d69c0d759f28] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:26.283868 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:26.284317 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:26.285079 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:26.285521 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:26.299241 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] HTTP exception thrown: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Request method failure captured: Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 HTTP/1.1 Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AeIaURPfHJhYbIwGRJsD3bh_X0lzP_vZoHzKsZf8HLPsq5SujgiPS1wtXx57lAolv3xxgLwCrBSJaipK81Iclsza_jAzlOPGJXuDf9-C3E0p5ii6ZETFIMyj_m5YRLUUF-XpdLqPs9CM9eTXFx9E_cn0ugRr0VOx-yBBa0U2LwH6DM Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:12:26.300749 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29aa58f150be4722ad251dad9a7f1a7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 29aa58f150be4722ad251dad9a7f1a7e Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-309370319 Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: f3484bf0457a407d954de53bf9bc8a91 Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-AttachVolumeNegativeTest-309370319-project Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.302445 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '51df7577-f191-4c2b-aaf4-d69c0d759f28'} Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:26.306882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. Aug 01 17:12:26.308895 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:26.310313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] Returning 404 to user: Instance 51df7577-f191-4c2b-aaf4-d69c0d759f28 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:26.310313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-675d89d2-5c56-45be-8772-d447afe95e5f tempest-AttachVolumeNegativeTest-309370319 tempest-AttachVolumeNegativeTest-309370319-project] 10.222.0.20 "GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28" status: 404 len: 111 microversion: 2.1 time: 0.029424 Aug 01 17:12:26.310313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:26 2022] GET /compute/v2.1/servers/51df7577-f191-4c2b-aaf4-d69c0d759f28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:27.085225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:27.085910 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:27.092570 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:27.093024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:27.093848 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:27.094323 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:27.310930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:27.314489 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:27.319041 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-955bcbbc-9226-43d0-8baf-ec20d0f467c2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.237742 Aug 01 17:12:27.330732 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 578/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:27 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:28.341027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:28.341647 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:28.344055 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:28.348845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:28.349299 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:28.350096 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:28.350544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:28.490501 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:28.499491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ac33b105-485d-448a-bbe4-1a33e964c8bc tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.162437 Aug 01 17:12:28.500347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 587/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:28 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:12:29.522804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:29.523707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:29.525988 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:29.526795 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:29.533225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:29.537233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:29.537233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:29.537233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:29.733651 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:29.743095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e6f44e0b-c91a-483d-a7d8-35c2429a33a1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.226175 Aug 01 17:12:29.743678 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 579/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:29 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:30.763814 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:30.764436 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:30.771091 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:30.771547 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:30.772320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:30.772765 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:30.910947 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:30.919239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b5a2fc1e-ac43-414f-8bba-01bf1360f7cd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.159458 Aug 01 17:12:30.919813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 588/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:30 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:31.706586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f9228e18-5d6a-465c-bd3a-a58a0be00ee2 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Action: 'create', calling method: .version_select at 0x7f7342360ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-359331894", "metadata": {"Type": "work"}}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:31.940033 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:31.940687 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:31.947172 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:31.947631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:31.948424 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:31.949511 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:32.084721 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:32.092290 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-dbfc25dc-9496-46ee-874d-171f79813c59 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.156156 Aug 01 17:12:32.092866 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 589/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:31 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:12:32.375219 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f9228e18-5d6a-465c-bd3a-a58a0be00ee2 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.784326 Aug 01 17:12:32.375889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 580/1169] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 1 17:12:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 786 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 17:12:32.388036 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-be66d254-2495-4f93-8919-5ba9989e5ab4 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733dc698b0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:32.436174 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-be66d254-2495-4f93-8919-5ba9989e5ab4 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 200 len: 352 microversion: 2.1 time: 0.051965 Aug 01 17:12:32.436747 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 590/1170] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:12:32 2022] GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:32.851207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-e621f1ac-2555-441e-be10-43d6880fe21c req-4164670b-36e3-4feb-a500-15a7c1e3c9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f17911-8e13-4327-808a-1b859ef0ccd9", "name": "network-vif-plugged", "status": "completed", "tag": "915f91a8-1aa3-431a-b1c8-2cd151733fac"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:32.862372 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e621f1ac-2555-441e-be10-43d6880fe21c req-4164670b-36e3-4feb-a500-15a7c1e3c9ac service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:32.862807 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e621f1ac-2555-441e-be10-43d6880fe21c req-4164670b-36e3-4feb-a500-15a7c1e3c9ac service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:32.873036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-e621f1ac-2555-441e-be10-43d6880fe21c req-4164670b-36e3-4feb-a500-15a7c1e3c9ac service nova] Creating event network-vif-plugged:915f91a8-1aa3-431a-b1c8-2cd151733fac for instance 06f17911-8e13-4327-808a-1b859ef0ccd9 on hv-cinder-84989 Aug 01 17:12:32.877929 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-e621f1ac-2555-441e-be10-43d6880fe21c req-4164670b-36e3-4feb-a500-15a7c1e3c9ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085700 Aug 01 17:12:32.878568 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 581/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:33.113605 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:33.114208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:33.120667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:33.124047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:33.124047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:33.124047 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:33.317090 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:33.325452 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-e3ed8b3c-228d-4fae-9573-1e9ee2d4cf78 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.216368 Aug 01 17:12:33.330772 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 591/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:33 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:33.451544 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8e78fa3a-58ea-4a4d-a7ff-f3ef6cd25838 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733d97cdc0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:33.497609 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8e78fa3a-58ea-4a4d-a7ff-f3ef6cd25838 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 200 len: 353 microversion: 2.1 time: 0.051129 Aug 01 17:12:33.498242 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 582/1173] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:12:33 2022] GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:33.510399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a372989b-314f-4ea4-8c29-3d511b704c62 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733de75c10>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:33.558556 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a372989b-314f-4ea4-8c29-3d511b704c62 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 200 len: 353 microversion: 2.1 time: 0.051330 Aug 01 17:12:33.559131 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 592/1174] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:12:33 2022] GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:33.576721 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2547580c-c0ed-4cd9-93be-6c9389a0647c tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733dcbe9d0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:33.750852 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2547580c-c0ed-4cd9-93be-6c9389a0647c tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 202 len: 0 microversion: 2.1 time: 0.178498 Aug 01 17:12:33.752861 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 583/1175] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 1 17:12:33 2022] DELETE /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 17:12:33.759730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ae80527b-079f-43bc-8db1-b684e9f17bd3 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733dc69d30>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:33.806149 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ae80527b-079f-43bc-8db1-b684e9f17bd3 tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 200 len: 352 microversion: 2.1 time: 0.050251 Aug 01 17:12:33.806734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 593/1176] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:12:33 2022] GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:12:34.346400 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:34.347143 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:34.353926 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:34.354399 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:34.355790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:34.356225 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:34.489772 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:34.498019 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4cf3b104-a725-4f4d-9cfc-e49f7258200a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1267 microversion: 2.1 time: 0.155983 Aug 01 17:12:34.498606 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 584/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:34 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:34.821405 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9dafc84c-228d-4d18-8aef-6f98691d431e tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Calling method '.version_select at 0x7f733dde61f0>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:34.850744 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-9dafc84c-228d-4d18-8aef-6f98691d431e tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] HTTP exception thrown: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9dafc84c-228d-4d18-8aef-6f98691d431e tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Request method failure captured: Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 HTTP/1.1 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6Al_w0jhVst35DKiV5IYwZHC7f4P8Q6g5NtVGqQuRzP-mGsgnbnOZFcESSgfQ56IJT0De3pQ2WETGol_WVbJ1WnErTQiuCa348hXsOFONCx6mbwDeHacEsOXEGvGog-GlfwY4Q4M-cefOW0sWvkQxySCbSH5agdctbPjrYHxZhFVd-A Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 5cf76caff097453487a7eed0dd7801e9 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesGetTestJSON-1803975967 Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:12:34.852703 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5cf76caff097453487a7eed0dd7801e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5cf76caff097453487a7eed0dd7801e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cf76caff097453487a7eed0dd7801e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5cf76caff097453487a7eed0dd7801e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesGetTestJSON-1803975967 Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 5cf76caff097453487a7eed0dd7801e9 Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesGetTestJSON-1803975967 Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesGetTestJSON-1803975967-project Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: b88ebdd7b20743e285c2b98397a359be Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesGetTestJSON-1803975967-project Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '44b45341-8451-43f8-a543-c00ef712a3f0'} Aug 01 17:12:34.854476 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. (HTTP 404) (Request-ID: req-ca5da2f6-f3c7-42bc-9218-a1a2dcac10d0) Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:34.855559 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 17:12:34.857098 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 17:12:34.859228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-9dafc84c-228d-4d18-8aef-6f98691d431e tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] Returning 404 to user: Volume 44b45341-8451-43f8-a543-c00ef712a3f0 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-9dafc84c-228d-4d18-8aef-6f98691d431e tempest-VolumesGetTestJSON-1803975967 tempest-VolumesGetTestJSON-1803975967-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0" status: 404 len: 109 microversion: 2.1 time: 0.037946 Aug 01 17:12:34.860735 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 594/1178] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 1 17:12:34 2022] GET /compute/v2.1/os-volumes/44b45341-8451-43f8-a543-c00ef712a3f0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:12:35.518352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:35.518967 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:35.525693 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:35.526104 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:35.526869 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:35.527303 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:35.664707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:35.672894 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5fff471d-aa47-4f06-8481-8f13a9e2e927 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1454 microversion: 2.1 time: 0.158429 Aug 01 17:12:35.673473 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 585/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:35 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:35.692921 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:12:35.695887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:12:35.695887 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:35.700197 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:35.700660 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:35.701430 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:35.701869 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:35.853913 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:12:35.863313 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0374ac46-53cf-46e4-bea3-cb99f88882a3 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1454 microversion: 2.1 time: 0.174241 Aug 01 17:12:35.863880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 595/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:12:35 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:12:38.067889 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-245cc31a-e6d0-485c-9a40-244ea5c11ae5 req-9c684a4a-3eb4-44fa-8ccc-5ff5a9eb16ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f17911-8e13-4327-808a-1b859ef0ccd9", "tag": "915f91a8-1aa3-431a-b1c8-2cd151733fac"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:12:38.078362 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-245cc31a-e6d0-485c-9a40-244ea5c11ae5 req-9c684a4a-3eb4-44fa-8ccc-5ff5a9eb16ff service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:12:38.078815 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-245cc31a-e6d0-485c-9a40-244ea5c11ae5 req-9c684a4a-3eb4-44fa-8ccc-5ff5a9eb16ff service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:12:38.090101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-245cc31a-e6d0-485c-9a40-244ea5c11ae5 req-9c684a4a-3eb4-44fa-8ccc-5ff5a9eb16ff service nova] Creating event network-changed:915f91a8-1aa3-431a-b1c8-2cd151733fac for instance 06f17911-8e13-4327-808a-1b859ef0ccd9 on hv-cinder-84989 Aug 01 17:12:38.095443 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-245cc31a-e6d0-485c-9a40-244ea5c11ae5 req-9c684a4a-3eb4-44fa-8ccc-5ff5a9eb16ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031202 Aug 01 17:12:38.096049 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 586/1181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:13:28.284491 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:13:28.285062 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:13:29.308167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:13:29.308763 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:14:02.772808 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=1 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:02.773569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=42 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:02.777483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-241151717", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "networks": [{"uuid": "ab42c5b3-e4ae-41cb-993c-806ef2673253"}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:02.832336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] validate_networks() for [('ab42c5b3-e4ae-41cb-993c-806ef2673253', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:14:03.223180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:14:03.223180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:14:03.223180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:14:03.223180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:14:03.223180 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:14:03.232312 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:03.232758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:03.233557 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:03.234000 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:03.250813 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Getting quotas for project 373368f3276a4b75bdc37f4510ea6b8b. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:14:03.254755 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Getting quotas for user 24a9a164af284f04a1f3580bc7f133e5 and project 373368f3276a4b75bdc37f4510ea6b8b. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:14:03.266287 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:14:03.268520 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:14:03.401608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-8c2526aa-7e13-4832-892e-baab21d320ab tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631231 Aug 01 17:14:03.402406 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 596/1182] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 17:14:03.411527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:03.412260 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=22 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:03.416824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9bd65c07-a63d-4644-8bee-9fb173f14e07 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:03.417530 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9bd65c07-a63d-4644-8bee-9fb173f14e07 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:03.470801 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9bd65c07-a63d-4644-8bee-9fb173f14e07 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:03.478528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9bd65c07-a63d-4644-8bee-9fb173f14e07 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1213 microversion: 2.1 time: 0.069089 Aug 01 17:14:03.479098 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:03 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:04.500283 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:04.500865 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:04.507695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:04.508144 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:04.508910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:04.509348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:04.573330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:04.581010 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-2ba8c735-aea3-468e-86ab-ade324370d95 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1217 microversion: 2.1 time: 0.085393 Aug 01 17:14:04.581566 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 597/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:04 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:05.603020 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:05.603637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:05.612148 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:05.612598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:05.613363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:05.613804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:05.678424 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:05.686629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cdd7b216-b963-46d1-ae3a-eec7b1544d49 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1283 microversion: 2.1 time: 0.087987 Aug 01 17:14:05.687209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 588/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:05 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:06.708858 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:06.709500 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:06.716669 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:06.717254 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:06.718252 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:06.718751 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:06.918509 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:06.925937 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-4ab81ced-8e9d-4619-8101-fe898bb45a57 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.221693 Aug 01 17:14:06.926526 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 598/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:06 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:06.988159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-c07f12d1-c23b-4e15-ba01-d2a8a2d131f1 req-8032f8e5-522e-4aef-9eda-975f3263902a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592b1743-068d-4b49-8819-a15c744d2191", "tag": "8ded51a4-4d29-4845-961b-84bf353994bb"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:07.000152 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c07f12d1-c23b-4e15-ba01-d2a8a2d131f1 req-8032f8e5-522e-4aef-9eda-975f3263902a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:07.000601 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c07f12d1-c23b-4e15-ba01-d2a8a2d131f1 req-8032f8e5-522e-4aef-9eda-975f3263902a service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:07.011970 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-c07f12d1-c23b-4e15-ba01-d2a8a2d131f1 req-8032f8e5-522e-4aef-9eda-975f3263902a service nova] Creating event network-changed:8ded51a4-4d29-4845-961b-84bf353994bb for instance 592b1743-068d-4b49-8819-a15c744d2191 on hv-cinder-84989 Aug 01 17:14:07.017759 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-c07f12d1-c23b-4e15-ba01-d2a8a2d131f1 req-8032f8e5-522e-4aef-9eda-975f3263902a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033039 Aug 01 17:14:07.021386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 589/1187] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:14:07.947946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:07.948583 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:07.955071 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:07.955525 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:07.956288 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:07.956729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:08.085898 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:08.093330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-25fc4bae-8ea1-43fc-980c-0f470213c8ca tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.149262 Aug 01 17:14:08.093891 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 599/1188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:07 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:09.116194 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:09.117164 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:09.123800 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:09.124250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:09.125007 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:09.125446 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:09.257705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:09.265548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-982d55be-37d8-46d3-8a5a-01be87356fe1 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.154646 Aug 01 17:14:09.266140 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 590/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:09 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:10.287321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:10.288051 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:10.294580 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:10.295027 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:10.295787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:10.296224 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:10.425785 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:10.433336 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-45edcf48-8a78-4ed2-bb01-fc92dd229af9 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.149860 Aug 01 17:14:10.433902 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 600/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:10 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:11.454976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:11.455519 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:11.462683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:11.463154 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:11.463911 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:11.464337 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:11.592483 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:11.600574 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7da797c9-45f1-4ad1-b340-62c678d9243e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.148961 Aug 01 17:14:11.601168 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 591/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:11 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:12.622220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:12.622831 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:12.629308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:12.629761 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:12.630561 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:12.631003 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:12.758334 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:12.765776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ef6d5f15-349d-46a5-8e9c-6eac16d8985d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.147564 Aug 01 17:14:12.766375 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 601/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:12 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:13.309976 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7260cb51-7e89-4bcf-b245-99370369913d req-cbd7e499-097f-4c35-a6bc-bf7f7154218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592b1743-068d-4b49-8819-a15c744d2191", "name": "network-vif-plugged", "status": "completed", "tag": "8ded51a4-4d29-4845-961b-84bf353994bb"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:13.320930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7260cb51-7e89-4bcf-b245-99370369913d req-cbd7e499-097f-4c35-a6bc-bf7f7154218b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:13.321405 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7260cb51-7e89-4bcf-b245-99370369913d req-cbd7e499-097f-4c35-a6bc-bf7f7154218b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:13.332126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7260cb51-7e89-4bcf-b245-99370369913d req-cbd7e499-097f-4c35-a6bc-bf7f7154218b service nova] Creating event network-vif-plugged:8ded51a4-4d29-4845-961b-84bf353994bb for instance 592b1743-068d-4b49-8819-a15c744d2191 on hv-cinder-84989 Aug 01 17:14:13.337735 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7260cb51-7e89-4bcf-b245-99370369913d req-cbd7e499-097f-4c35-a6bc-bf7f7154218b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Aug 01 17:14:13.338386 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 592/1193] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:14:13.786827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:13.787451 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:13.789514 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:13.790189 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:13.795390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:13.795841 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:13.796597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:13.797028 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:13.926933 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:13.935262 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-6a18af82-09c7-4c18-81f9-7a6f4fbf2b8d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.152307 Aug 01 17:14:13.935850 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 602/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:13 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:14.953614 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:14.958231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:14.958937 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:14.965716 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:14.966198 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:14.966962 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:14.967399 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:15.098924 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:15.106892 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e0a05f21-f72b-46b7-9a3a-02dbd5e229ae tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1313 microversion: 2.1 time: 0.153985 Aug 01 17:14:15.107466 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 593/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:14 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:16.128126 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:16.128767 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:16.135909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:16.136358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:16.137167 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:16.137666 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:16.269433 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:16.276928 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cf9cf721-4c20-43dc-b08f-27195ff4d070 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1498 microversion: 2.1 time: 0.152707 Aug 01 17:14:16.277564 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 603/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:16 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:17.039454 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:17.039926 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:17.046221 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:17.046702 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:17.047452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:17.047875 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:17.075450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:14:17.370836 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7e7668d-93a0-48ed-9b0b-fcb87e8c2c1b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "DELETE /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 204 len: 0 microversion: 2.1 time: 0.335102 Aug 01 17:14:17.371477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 594/1197] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:14:17 2022] DELETE /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:14:17.379577 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:17.380194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:17.387415 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:17.387873 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:17.388638 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:17.389076 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:17.516893 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:17.524343 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ce26426a-21b4-4ee8-9639-a57c5bb2801b tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1504 microversion: 2.1 time: 0.148593 Aug 01 17:14:17.524910 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 604/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:17 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:18.545494 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:18.546223 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:18.552753 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:18.553203 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:18.553985 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:18.554430 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:18.685573 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:18.693053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0be4c220-52a7-43c8-bce4-b14dc852f67a tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1504 microversion: 2.1 time: 0.152029 Aug 01 17:14:18.693629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 595/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:18 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:19.661712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-9e356c1e-1e71-49d1-8754-dac67f55054e req-c54d09d4-33c6-4e9a-9eeb-af8832c85003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592b1743-068d-4b49-8819-a15c744d2191", "name": "network-vif-deleted", "tag": "8ded51a4-4d29-4845-961b-84bf353994bb"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:19.671575 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9e356c1e-1e71-49d1-8754-dac67f55054e req-c54d09d4-33c6-4e9a-9eeb-af8832c85003 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:19.672019 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-9e356c1e-1e71-49d1-8754-dac67f55054e req-c54d09d4-33c6-4e9a-9eeb-af8832c85003 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:19.683729 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-9e356c1e-1e71-49d1-8754-dac67f55054e req-c54d09d4-33c6-4e9a-9eeb-af8832c85003 service nova] Creating event network-vif-deleted:8ded51a4-4d29-4845-961b-84bf353994bb for instance 592b1743-068d-4b49-8819-a15c744d2191 on hv-cinder-84989 Aug 01 17:14:19.689023 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-9e356c1e-1e71-49d1-8754-dac67f55054e req-c54d09d4-33c6-4e9a-9eeb-af8832c85003 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Aug 01 17:14:19.689606 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 605/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:14:19.714776 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:19.715409 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:19.721845 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:19.722291 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:19.723051 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:19.723486 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:19.786903 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:19.795262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b4f4e5dc-b9d4-4420-9e66-f5792c3893ff tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 200 len: 1462 microversion: 2.1 time: 0.084456 Aug 01 17:14:19.795841 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 596/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:19 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:14:20.817569 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:20.818294 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 592b1743-068d-4b49-8819-a15c744d2191] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:20.824489 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:20.824929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:20.825673 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:20.826133 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:20.838894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] HTTP exception thrown: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Request method failure captured: Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 HTTP/1.1 Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AnYdltnzNlEvDGXSth2CtYcNlDL1OUapM2kDWKXKWv4R3KQzdAbPimJGQwPRePtAOImL15DWOpwRerR97Qsw0J8_MeXiwbD0gzRHX7GypQReCdoX6FqCI9pyPmXLeigHVVIxzEDKhDVxKfzAdrSg_GPNhirFduxHxNQ-0RorLkmbYA Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: 373368f3276a4b75bdc37f4510ea6b8b Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:14:20.840468 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: 373368f3276a4b75bdc37f4510ea6b8b Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-VolumesActionsTest-1365855090-project Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 24a9a164af284f04a1f3580bc7f133e5 Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-VolumesActionsTest-1365855090-project Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. Aug 01 17:14:20.842297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '592b1743-068d-4b49-8819-a15c744d2191'} Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:14:20.843535 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. Aug 01 17:14:20.845235 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:14:20.846825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Returning 404 to user: Instance 592b1743-068d-4b49-8819-a15c744d2191 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:14:20.846825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-08baf5b0-175d-4533-ba95-60c6746b267d tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191" status: 404 len: 111 microversion: 2.1 time: 0.028951 Aug 01 17:14:20.846825 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:20 2022] GET /compute/v2.1/servers/592b1743-068d-4b49-8819-a15c744d2191 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:14:20.891859 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-339445933", "imageRef": "9c692d0d-fd05-4a60-8882-fb1abd2d6da5", "flavorRef": "452", "networks": [{"uuid": "ab42c5b3-e4ae-41cb-993c-806ef2673253"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:20.945804 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] validate_networks() for [('ab42c5b3-e4ae-41cb-993c-806ef2673253', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:14:21.287704 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:14:21.288122 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:14:21.288590 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:14:21.288996 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:14:21.290277 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:14:21.299081 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:21.299706 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:21.300294 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:21.300730 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:21.317147 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Getting quotas for project 373368f3276a4b75bdc37f4510ea6b8b. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:14:21.321026 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Getting quotas for user 24a9a164af284f04a1f3580bc7f133e5 and project 373368f3276a4b75bdc37f4510ea6b8b. Resources: {'ram', 'cores', 'instances'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:14:21.331739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:14:21.333972 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9c692d0d-fd05-4a60-8882-fb1abd2d6da5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:14:21.475135 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ef556fe2-8a92-4535-aabc-415ccd05b836 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586995 Aug 01 17:14:21.475790 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 597/1203] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:14:21.486918 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b344bb26-393f-4bc3-a0c0-ab65c4f2063c tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:21.487675 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b344bb26-393f-4bc3-a0c0-ab65c4f2063c tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:21.540880 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b344bb26-393f-4bc3-a0c0-ab65c4f2063c tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:21.547667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b344bb26-393f-4bc3-a0c0-ab65c4f2063c tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1213 microversion: 2.1 time: 0.064557 Aug 01 17:14:21.548280 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 607/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:21 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:22.569652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:22.570292 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:22.577872 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:22.578343 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:22.579120 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:22.579552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:22.643368 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:22.651227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2eacaf44-7420-4ca5-b41d-53872c90d3a0 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1265 microversion: 2.1 time: 0.086003 Aug 01 17:14:22.651824 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 598/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:22 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:23.672432 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:23.673567 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:23.681498 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:23.681946 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:23.682753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:23.683186 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:23.752519 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:23.759943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-02a70e39-647b-4c57-832c-5f99d1e06ebe tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1271 microversion: 2.1 time: 0.091553 Aug 01 17:14:23.760508 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 608/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:23 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:24.780951 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:24.781566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:24.790227 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:24.790683 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:24.791457 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:24.791902 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:24.827587 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-36626379-ad80-4453-b274-3391cad05165 req-1cb728f2-b2c0-499c-8c88-7a131e49cc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dea04c-0c96-40b3-a23a-69755e50fbc2", "tag": "339b7f31-8969-4435-8f55-c2ead2097e27"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:24.838043 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-36626379-ad80-4453-b274-3391cad05165 req-1cb728f2-b2c0-499c-8c88-7a131e49cc15 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:24.840710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-36626379-ad80-4453-b274-3391cad05165 req-1cb728f2-b2c0-499c-8c88-7a131e49cc15 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:24.849544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-36626379-ad80-4453-b274-3391cad05165 req-1cb728f2-b2c0-499c-8c88-7a131e49cc15 service nova] Creating event network-changed:339b7f31-8969-4435-8f55-c2ead2097e27 for instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 on hv-cinder-84989 Aug 01 17:14:24.855602 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-36626379-ad80-4453-b274-3391cad05165 req-1cb728f2-b2c0-499c-8c88-7a131e49cc15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031240 Aug 01 17:14:24.863552 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 609/1207] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:14:25.058471 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:25.065882 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3df86a79-34d6-4ef0-b72d-2d9c55101525 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.289073 Aug 01 17:14:25.066492 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 599/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:24 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:26.087737 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:26.088446 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:26.094699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:26.095153 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:26.095914 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:26.096354 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:26.226207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:26.233056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-25781229-1c40-442d-941a-06fb12be9ed7 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.150170 Aug 01 17:14:26.233631 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 610/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:26 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:27.253652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:27.254297 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:27.261946 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:27.262423 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:27.263192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:27.263629 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:27.397991 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:27.405930 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3e9d4937-a7d9-4c5b-acbc-4e6c871aa380 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.156094 Aug 01 17:14:27.406536 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 600/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:27 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:28.427298 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:28.427906 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:28.434753 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:28.435207 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:28.435980 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:28.436411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:28.566025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:28.574240 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-93ca6980-4f51-46ed-a0ff-8f52bfa71484 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.150735 Aug 01 17:14:28.574812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 611/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:28 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:29.595209 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:29.595831 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:29.603055 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:29.603506 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:29.604270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:29.604708 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:29.741320 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:29.749497 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7b3c353c-180f-4e27-9458-8aefe058ea45 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.158103 Aug 01 17:14:29.753508 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 601/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:29 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:30.770844 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:30.771434 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:30.778001 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:30.778472 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:30.779220 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:30.779650 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:30.910993 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:30.918838 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-05a4de1a-e759-405b-93a2-376556b9c860 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.151918 Aug 01 17:14:30.919401 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 612/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:30 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:31.378302 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-6396751d-90c2-4780-a552-fae8e2b48552 req-2591ee77-bf4b-42e0-91c9-872fc906920f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dea04c-0c96-40b3-a23a-69755e50fbc2", "name": "network-vif-plugged", "status": "completed", "tag": "339b7f31-8969-4435-8f55-c2ead2097e27"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:31.383951 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:31.384598 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:31.389899 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6396751d-90c2-4780-a552-fae8e2b48552 req-2591ee77-bf4b-42e0-91c9-872fc906920f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:31.390363 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6396751d-90c2-4780-a552-fae8e2b48552 req-2591ee77-bf4b-42e0-91c9-872fc906920f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:31.401771 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-6396751d-90c2-4780-a552-fae8e2b48552 req-2591ee77-bf4b-42e0-91c9-872fc906920f service nova] Creating event network-vif-plugged:339b7f31-8969-4435-8f55-c2ead2097e27 for instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 on hv-cinder-84989 Aug 01 17:14:31.406829 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-6396751d-90c2-4780-a552-fae8e2b48552 req-2591ee77-bf4b-42e0-91c9-872fc906920f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Aug 01 17:14:31.407417 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 602/1214] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:14:31.940830 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:31.941376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:31.943352 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:31.948927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:31.949377 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:31.950201 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:31.950635 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:32.078161 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:32.085396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-a236906a-ba2c-4653-b16f-f992a84a9253 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.148612 Aug 01 17:14:32.085957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 613/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:31 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:33.109348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:33.110053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:33.116639 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:33.117093 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:33.118510 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:33.119110 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:33.249613 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:33.257233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-537dfc8a-5c50-4210-a1ee-7b19317d048f tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1313 microversion: 2.1 time: 0.153454 Aug 01 17:14:33.265440 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 603/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:33 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:34.278886 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:34.279513 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:34.281796 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:34.286678 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:34.287132 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:34.287899 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:34.288366 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:34.291601 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=87 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:34.421992 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:34.429369 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-312bc688-3436-476f-b126-4ee5e1007f30 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1498 microversion: 2.1 time: 0.155145 Aug 01 17:14:34.429942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 614/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:34 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:35.129711 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:35.130286 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:35.136652 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:35.137095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:35.137848 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:35.138306 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:35.163108 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:14:35.189919 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:35.393452 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a318bc53-1b40-466a-b883-00eebcffac04 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 204 len: 0 microversion: 2.1 time: 0.267171 Aug 01 17:14:35.393982 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 604/1218] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:14:35 2022] DELETE /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:14:35.402885 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:35.403608 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:35.410259 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:35.410705 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:35.411465 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:35.411894 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:35.543147 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:35.550662 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-0779bb9e-704a-4b59-a825-5817a7dae3c5 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1504 microversion: 2.1 time: 0.152289 Aug 01 17:14:35.551230 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 615/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:35 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:36.579623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:36.579623 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:36.582002 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:36.582491 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:36.583262 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:36.583695 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:36.717136 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:36.724669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-79a97026-f0e1-4631-99c7-ba19cd9256ea tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1504 microversion: 2.1 time: 0.156308 Aug 01 17:14:36.725252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 605/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:36 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:37.424135 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-e9d41ba8-db43-4c59-9341-107877d37a38 req-8cbb0b56-b4c8-490f-a8fc-e85630c9272b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dea04c-0c96-40b3-a23a-69755e50fbc2", "name": "network-vif-deleted", "tag": "339b7f31-8969-4435-8f55-c2ead2097e27"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:37.434130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-e9d41ba8-db43-4c59-9341-107877d37a38 req-8cbb0b56-b4c8-490f-a8fc-e85630c9272b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:37.437709 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-e9d41ba8-db43-4c59-9341-107877d37a38 req-8cbb0b56-b4c8-490f-a8fc-e85630c9272b service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:37.445373 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-e9d41ba8-db43-4c59-9341-107877d37a38 req-8cbb0b56-b4c8-490f-a8fc-e85630c9272b service nova] Creating event network-vif-deleted:339b7f31-8969-4435-8f55-c2ead2097e27 for instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 on hv-cinder-84989 Aug 01 17:14:37.451325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-e9d41ba8-db43-4c59-9341-107877d37a38 req-8cbb0b56-b4c8-490f-a8fc-e85630c9272b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Aug 01 17:14:37.451986 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 616/1221] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:14:37.746797 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:37.747412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:37.753940 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:37.754425 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:37.755188 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:37.755627 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:37.820586 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:37.828101 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dc9aebb3-79c8-4612-9859-8fed0a9fa785 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1462 microversion: 2.1 time: 0.085156 Aug 01 17:14:37.828669 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 606/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:37 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:38.850358 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:38.851130 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:38.858330 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:38.858781 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:38.859544 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:38.859982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:38.921571 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:38.929124 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-18e6c9a2-fb99-46bf-87c6-309419723820 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1298 microversion: 2.1 time: 0.083462 Aug 01 17:14:38.929688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 617/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:38 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:39.951917 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:39.952552 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:39.954975 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:39.959637 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:39.960077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:39.960823 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:39.961250 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:40.022560 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:40.030915 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ded5687b-bec2-4da4-aa88-a113fe5fcb29 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1298 microversion: 2.1 time: 0.084449 Aug 01 17:14:40.031477 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 607/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:39 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:41.052699 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:41.053341 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:41.059877 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:41.060323 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:41.061077 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:41.061510 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:41.092194 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:41.092643 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:41.093088 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.objects.instance [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lazy-loading 'fault' on Instance uuid 18dea04c-0c96-40b3-a23a-69755e50fbc2 {{(pid=124835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:14:41.137272 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a9a164af284f04a1f3580bc7f133e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373368f3276a4b75bdc37f4510ea6b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:41.144654 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-3f1fe79d-f9a3-49f8-8544-66c91f9f6c51 tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 200 len: 1303 microversion: 2.1 time: 0.095855 Aug 01 17:14:41.145211 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 618/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:41 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:42.167024 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:42.167676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] [instance: 18dea04c-0c96-40b3-a23a-69755e50fbc2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:42.174631 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:42.175080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:42.175843 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:42.176279 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:42.190361 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] HTTP exception thrown: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Request method failure captured: Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 HTTP/1.1 Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AnYdltnzNlEvDGXSth2CtYcNlDL1OUapM2kDWKXKWv4R3KQzdAbPimJGQwPRePtAOImL15DWOpwRerR97Qsw0J8_MeXiwbD0gzRHX7GypQReCdoX6FqCI9pyPmXLeigHVVIxzEDKhDVxKfzAdrSg_GPNhirFduxHxNQ-0RorLkmbYA Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: 373368f3276a4b75bdc37f4510ea6b8b Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:14:42.192009 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/373368f3276a4b75bdc37f4510ea6b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 373368f3276a4b75bdc37f4510ea6b8b Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesActionsTest-1365855090 Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesActionsTest-1365855090-project Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 24a9a164af284f04a1f3580bc7f133e5 Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesActionsTest-1365855090-project Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. Aug 01 17:14:42.193803 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '18dea04c-0c96-40b3-a23a-69755e50fbc2'} Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:14:42.194798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. Aug 01 17:14:42.197548 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:14:42.199094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] Returning 404 to user: Instance 18dea04c-0c96-40b3-a23a-69755e50fbc2 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:14:42.199094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-671edad3-22b9-40ad-b587-7684ed98681e tempest-VolumesActionsTest-1365855090 tempest-VolumesActionsTest-1365855090-project] 10.222.0.20 "GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2" status: 404 len: 111 microversion: 2.1 time: 0.031025 Aug 01 17:14:42.199094 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 608/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:42 2022] GET /compute/v2.1/servers/18dea04c-0c96-40b3-a23a-69755e50fbc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:14:48.731228 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1847845813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131523973", "security_groups": [{"name": "tempest-secgroup-smoke-2093562813"}], "block_device_mapping_v2": [{"uuid": "4b4253c1-6753-4898-8104-594ce58e7616", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb"}]}} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:48.842325 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.network.neutron [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] validate_networks() for [('c93d53dd-09ce-4ed0-bc52-4a648dd0b6bb', None, None, None, None, None)] {{(pid=124835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 17:14:49.210855 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 17:14:49.211915 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image limits 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 17:14:49.212550 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Flavor pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 17:14:49.212957 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Image pref 0:0:0 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 17:14:49.213367 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.virt.hardware [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 17:14:49.222411 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:49.222867 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:49.223710 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:49.224150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:49.241032 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 17:14:49.245026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.quota [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Getting quotas for user 8ca353ec7cb948c9a803e6422ea3476e and project c2cff009abd049a7aff67696680687ca. Resources: {'ram', 'cores', 'instances'} {{(pid=124835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 17:14:49.301208 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Going to run 1 instances... {{(pid=124835) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 17:14:49.303324 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b4253c1-6753-4898-8104-594ce58e7616',volume_size=None,volume_type=None)] {{(pid=124835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 17:14:49.726249 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5bd617bc-9a14-4aa7-9990-d612f5ace1d8 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999073 Aug 01 17:14:49.726954 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 619/1227] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 1 17:14:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 17:14:49.738175 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-be8e14df-2f80-41f0-a5b8-cc5b05de9edf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:49.738798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-be8e14df-2f80-41f0-a5b8-cc5b05de9edf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:49.795742 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be8e14df-2f80-41f0-a5b8-cc5b05de9edf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:49.802371 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-be8e14df-2f80-41f0-a5b8-cc5b05de9edf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1095 microversion: 2.1 time: 0.068103 Aug 01 17:14:49.803047 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 609/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:49 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:50.823518 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:50.824132 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:50.830849 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:50.831297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:50.832056 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:50.832490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:50.892942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:50.900688 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-ef2cba9c-afba-4d5f-a2bd-1c2c67e621db tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1145 microversion: 2.1 time: 0.081227 Aug 01 17:14:50.901251 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 620/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:50 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:51.921480 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:51.922114 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:51.928253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:51.928701 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:51.929462 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:51.929907 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:51.991593 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:51.999231 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-748fe076-1e5e-444a-b980-28def5d9277a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1193 microversion: 2.1 time: 0.081545 Aug 01 17:14:51.999817 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 610/1230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:51 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:53.026724 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:53.029466 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:53.038621 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:53.039118 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:53.040835 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:53.041285 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:53.247387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:53.255905 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b22a0d8f-49b2-4fd8-a6ed-7ffe48714a46 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1279 microversion: 2.1 time: 0.239290 Aug 01 17:14:53.260664 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 621/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:53 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:53.822212 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-6db2ee11-7a88-4f31-82b8-77c8cfe958e5 req-7ff8ff0d-323a-4ac6-a994-b5720e3a82d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52b76ea-664a-4c90-8b1c-d9b81fbfc43e", "tag": "553271ab-2a9a-4aeb-a4b5-42030dd93b43"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:14:53.834324 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6db2ee11-7a88-4f31-82b8-77c8cfe958e5 req-7ff8ff0d-323a-4ac6-a994-b5720e3a82d5 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:53.843023 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6db2ee11-7a88-4f31-82b8-77c8cfe958e5 req-7ff8ff0d-323a-4ac6-a994-b5720e3a82d5 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:53.854819 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-6db2ee11-7a88-4f31-82b8-77c8cfe958e5 req-7ff8ff0d-323a-4ac6-a994-b5720e3a82d5 service nova] Creating event network-changed:553271ab-2a9a-4aeb-a4b5-42030dd93b43 for instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e on hv-cinder-84989 Aug 01 17:14:53.861756 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-6db2ee11-7a88-4f31-82b8-77c8cfe958e5 req-7ff8ff0d-323a-4ac6-a994-b5720e3a82d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044288 Aug 01 17:14:53.863217 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 611/1232] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:14:54.280011 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:54.280684 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:54.295337 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:54.296078 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:54.296882 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:54.297403 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:54.464454 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:54.472720 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-54aedfd3-b0ed-40e7-a82f-904bea39106b tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.196481 Aug 01 17:14:54.473671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 622/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:54 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:14:55.496233 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:55.497162 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:55.503722 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:55.504247 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:55.505077 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:55.505594 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:55.659599 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:55.681438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3830ef8e-6728-48b0-935a-e2775ba7437e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.189422 Aug 01 17:14:55.682352 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 612/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:55 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:56.703483 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:56.704116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:56.719925 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:56.720560 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:56.721827 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:56.722490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:56.873308 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:56.881548 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d7e6a61d-c184-4eff-9d49-8c88b1248597 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.182279 Aug 01 17:14:56.890113 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 623/1235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:56 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:14:57.903993 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:57.905357 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:57.912592 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:57.913397 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:57.914595 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:57.915857 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:58.063724 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:58.072605 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-be9ea1e4-badb-4e41-a055-9184f0888f0f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.173330 Aug 01 17:14:58.086662 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 613/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:57 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 17:14:59.093762 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:14:59.094321 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:14:59.101017 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:59.101469 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:59.102271 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:14:59.102712 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:14:59.232163 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=2 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:59.253388 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:14:59.256087 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell0:SELECT=6 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:59.264716 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-b36b70ce-c102-4ae5-90ae-ae1ab41cdeb2 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.174866 Aug 01 17:14:59.265297 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 624/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:14:59 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:00.287571 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:00.289189 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:00.297364 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:00.299965 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:00.300566 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:00.301770 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:00.302404 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:00.490421 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:00.502794 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-de2636ef-67d1-491c-aa30-893632c6d66f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.218955 Aug 01 17:15:00.514850 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 614/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:00 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:01.527276 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:01.528001 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:01.535659 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:01.536107 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:01.536900 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:01.537354 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:01.741025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:01.741025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d0085f39-25e9-43e0-8da7-0e9e69730715 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.180184 Aug 01 17:15:01.741025 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 625/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:01 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:02.725353 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:02.726827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:02.734728 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:02.735270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:02.736308 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:02.736949 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:02.881159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:02.890179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3d258da5-5431-4c32-890c-3a95e7e2b908 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.169262 Aug 01 17:15:02.912980 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 615/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:02 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:03.911588 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:03.912839 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:03.920464 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:03.921252 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:03.922348 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:03.923007 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:04.070700 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:04.079289 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5f254d01-3231-4875-9ae5-b01605fe745f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.171404 Aug 01 17:15:04.080212 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 626/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:03 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:05.101632 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:05.103579 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:05.112179 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:05.120528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:05.120528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:05.120528 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:05.276888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:05.285798 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-641bef31-5c7e-483d-bd86-25b78e1d16fd tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.188088 Aug 01 17:15:05.286905 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 616/1242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:05 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:05.752776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-4749830f-2c59-44a9-8ab3-a4f1ea152a5b req-4577b039-091c-4bb8-92db-a6e59c76709e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52b76ea-664a-4c90-8b1c-d9b81fbfc43e", "name": "network-vif-plugged", "status": "completed", "tag": "553271ab-2a9a-4aeb-a4b5-42030dd93b43"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:15:05.764966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:05.767061 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-4749830f-2c59-44a9-8ab3-a4f1ea152a5b req-4577b039-091c-4bb8-92db-a6e59c76709e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:05.770353 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-4749830f-2c59-44a9-8ab3-a4f1ea152a5b req-4577b039-091c-4bb8-92db-a6e59c76709e service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:05.770624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=72 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:05.781517 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-4749830f-2c59-44a9-8ab3-a4f1ea152a5b req-4577b039-091c-4bb8-92db-a6e59c76709e service nova] Creating event network-vif-plugged:553271ab-2a9a-4aeb-a4b5-42030dd93b43 for instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e on hv-cinder-84989 Aug 01 17:15:05.786776 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-4749830f-2c59-44a9-8ab3-a4f1ea152a5b req-4577b039-091c-4bb8-92db-a6e59c76709e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038151 Aug 01 17:15:05.787695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 627/1243] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:15:06.309387 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:06.310159 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:06.326475 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:06.326932 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:06.327913 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:06.328527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:06.358978 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:06.494126 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:06.503739 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1e1e5b8a-35d3-47f5-8ff1-c0da07e40dd6 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.198603 Aug 01 17:15:06.518778 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 617/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:06 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:07.527390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:07.528089 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:07.534941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:07.535386 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:07.536146 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:07.536578 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:07.671596 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:07.679013 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-f5a204fc-349b-41a3-977e-8309f33e30cf tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1267 microversion: 2.1 time: 0.157901 Aug 01 17:15:07.679736 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 628/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:07 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:08.701888 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:08.704070 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:08.708769 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:08.709222 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:08.710017 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:08.710478 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:08.839925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:08.847359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-848f499b-6f3a-406b-9667-0bc1662448d7 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1454 microversion: 2.1 time: 0.149569 Aug 01 17:15:08.847950 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 618/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:08 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:08.869603 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:15:08.870239 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:15:08.876982 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:08.877441 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:08.878274 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:08.878717 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:09.010665 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:15:09.018168 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-95939ae7-76d8-45ce-a440-d20064b71c3f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1454 microversion: 2.1 time: 0.152947 Aug 01 17:15:09.024365 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 629/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:15:08 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:15:11.300846 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-ac2d825f-f7df-434c-a1e6-c523c8dc4f5f req-5977a613-6df8-47f3-aafe-2faf3455abe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52b76ea-664a-4c90-8b1c-d9b81fbfc43e", "tag": "553271ab-2a9a-4aeb-a4b5-42030dd93b43"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:15:11.311575 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ac2d825f-f7df-434c-a1e6-c523c8dc4f5f req-5977a613-6df8-47f3-aafe-2faf3455abe2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:15:11.312036 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ac2d825f-f7df-434c-a1e6-c523c8dc4f5f req-5977a613-6df8-47f3-aafe-2faf3455abe2 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:15:11.323657 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-ac2d825f-f7df-434c-a1e6-c523c8dc4f5f req-5977a613-6df8-47f3-aafe-2faf3455abe2 service nova] Creating event network-changed:553271ab-2a9a-4aeb-a4b5-42030dd93b43 for instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e on hv-cinder-84989 Aug 01 17:15:11.329207 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-ac2d825f-f7df-434c-a1e6-c523c8dc4f5f req-5977a613-6df8-47f3-aafe-2faf3455abe2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 Aug 01 17:15:11.329810 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 619/1248] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:15:20.565052 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:15:20.565741 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:16:49.317929 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:16:49.318624 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:16:58.426834 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:16:58.427433 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:17:13.371842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_api:SELECT=5 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:17:13.374193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG dbcounter [-] [124835] Writing DB stats nova_cell1:SELECT=13 {{(pid=124835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:17:13.375123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=27 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:17:13.376076 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=13 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:17:13.378193 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:13.378854 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:13.386143 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:13.386610 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:13.387521 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:13.388074 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:13.418151 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Going to try to terminate instance {{(pid=124835) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:17:13.536257 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-683dc646-dde0-4f11-935d-ea29e22e2ed6 req-8e8ebdb9-c772-4733-8ec9-93e969848382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52b76ea-664a-4c90-8b1c-d9b81fbfc43e", "tag": "553271ab-2a9a-4aeb-a4b5-42030dd93b43"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:17:13.546551 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-683dc646-dde0-4f11-935d-ea29e22e2ed6 req-8e8ebdb9-c772-4733-8ec9-93e969848382 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:13.547001 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-683dc646-dde0-4f11-935d-ea29e22e2ed6 req-8e8ebdb9-c772-4733-8ec9-93e969848382 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:13.558053 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-683dc646-dde0-4f11-935d-ea29e22e2ed6 req-8e8ebdb9-c772-4733-8ec9-93e969848382 service nova] Creating event network-changed:553271ab-2a9a-4aeb-a4b5-42030dd93b43 for instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e on hv-cinder-84989 Aug 01 17:17:13.563925 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-683dc646-dde0-4f11-935d-ea29e22e2ed6 req-8e8ebdb9-c772-4733-8ec9-93e969848382 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191473 Aug 01 17:17:13.564719 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 620/1249] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:17:13.726393 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-5be03b79-e5ac-4613-b33a-c874423288a9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 204 len: 0 microversion: 2.1 time: 0.356088 Aug 01 17:17:13.727318 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 630/1250] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:17:13 2022] DELETE /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:17:13.736871 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:13.738332 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:13.745118 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:13.745973 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:13.747031 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:13.747394 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:13.941078 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:13.948676 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-456cd06d-a006-49da-8b31-e5a03a43b476 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1578 microversion: 2.1 time: 0.216800 Aug 01 17:17:13.949253 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 621/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:13 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:14.970988 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:14.971695 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:14.978691 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:14.979150 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:14.979927 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:14.980402 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:15.176490 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:15.185128 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-58087443-d385-4d70-a40c-a4a0ae083b9a tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1578 microversion: 2.1 time: 0.218462 Aug 01 17:17:15.185760 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 631/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:14 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:16.206830 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:16.207438 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:16.214597 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:16.215204 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:16.215979 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:16.216412 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:16.285401 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:16.293211 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9389341b-a0bb-4a4f-ae05-53c35e99f29f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1392 microversion: 2.1 time: 0.090463 Aug 01 17:17:16.293796 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 622/1253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:16 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:16.319943 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-8b890099-702c-4843-aec9-a3535af4a146 req-60217f36-0d3a-4163-8894-181e91823086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52b76ea-664a-4c90-8b1c-d9b81fbfc43e", "name": "network-vif-deleted", "tag": "553271ab-2a9a-4aeb-a4b5-42030dd93b43"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:17:16.330257 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-8b890099-702c-4843-aec9-a3535af4a146 req-60217f36-0d3a-4163-8894-181e91823086 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:16.330702 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-8b890099-702c-4843-aec9-a3535af4a146 req-60217f36-0d3a-4163-8894-181e91823086 service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:16.341438 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-8b890099-702c-4843-aec9-a3535af4a146 req-60217f36-0d3a-4163-8894-181e91823086 service nova] Creating event network-vif-deleted:553271ab-2a9a-4aeb-a4b5-42030dd93b43 for instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e on hv-cinder-84989 Aug 01 17:17:16.346609 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-8b890099-702c-4843-aec9-a3535af4a146 req-60217f36-0d3a-4163-8894-181e91823086 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113439 Aug 01 17:17:16.347252 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 632/1254] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:17:17.314699 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:17.315356 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:17.322123 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:17.322571 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:17.323517 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:17.323827 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:17.355822 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:17.356270 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:17.356748 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lazy-loading 'fault' on Instance uuid c52b76ea-664a-4c90-8b1c-d9b81fbfc43e {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 17:17:17.397597 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:17.406923 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a3ac02fe-044e-4a50-8624-9e34439e5f6f tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 200 len: 1231 microversion: 2.1 time: 0.095309 Aug 01 17:17:17.407504 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 623/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:17 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:18.428390 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:18.429093 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: c52b76ea-664a-4c90-8b1c-d9b81fbfc43e] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:18.435340 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:18.435787 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:18.436545 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:18.437149 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:18.450164 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] HTTP exception thrown: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Request method failure captured: Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e HTTP/1.1 Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AisdjTPMvhPzEgV9VP0mmxBfQEdsIOetDPGdjesNdgxckRua1PutPcC8yf1oN8Jk4HnvFY7ii67AUT8PDzqWCDd9OdYhmqMfEIxJKHdXEyEScWrmctkf2szvZB8wcSi4cEuZcJzc3Dai8VzjhRMtmlFPrWdNWnnZEPijAes7_GU1Xw Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:17:18.451758 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2cff009abd049a7aff67696680687ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2cff009abd049a7aff67696680687ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 8ca353ec7cb948c9a803e6422ea3476e Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. Aug 01 17:17:18.454320 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': 'c52b76ea-664a-4c90-8b1c-d9b81fbfc43e'} Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:17:18.455392 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. Aug 01 17:17:18.457116 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:18.458671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Returning 404 to user: Instance c52b76ea-664a-4c90-8b1c-d9b81fbfc43e could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:17:18.458671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-cf13e681-6d86-4046-855b-9721fec76d54 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e" status: 404 len: 111 microversion: 2.1 time: 0.029947 Aug 01 17:17:18.458671 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 633/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:18 2022] GET /compute/v2.1/servers/c52b76ea-664a-4c90-8b1c-d9b81fbfc43e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:17:21.756837 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:21.757449 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:21.759722 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-8ccb18d3-5510-4d09-924b-53ffaccf5cab req-7d64ba1e-ebff-4204-b976-000c7530b16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f17911-8e13-4327-808a-1b859ef0ccd9", "tag": "915f91a8-1aa3-431a-b1c8-2cd151733fac"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:17:21.765547 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:21.766304 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:21.767341 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:21.768507 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:21.770614 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-8ccb18d3-5510-4d09-924b-53ffaccf5cab req-7d64ba1e-ebff-4204-b976-000c7530b16f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:21.770872 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-8ccb18d3-5510-4d09-924b-53ffaccf5cab req-7d64ba1e-ebff-4204-b976-000c7530b16f service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:21.782455 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-8ccb18d3-5510-4d09-924b-53ffaccf5cab req-7d64ba1e-ebff-4204-b976-000c7530b16f service nova] Creating event network-changed:915f91a8-1aa3-431a-b1c8-2cd151733fac for instance 06f17911-8e13-4327-808a-1b859ef0ccd9 on hv-cinder-84989 Aug 01 17:17:21.787625 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-8ccb18d3-5510-4d09-924b-53ffaccf5cab req-7d64ba1e-ebff-4204-b976-000c7530b16f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032129 Aug 01 17:17:21.788226 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 634/1257] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 17:17:21.816171 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 17:17:22.104185 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7da7e843-7e6c-48e1-8887-ef89f6ebbec9 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 204 len: 0 microversion: 2.1 time: 0.351616 Aug 01 17:17:22.104860 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 624/1258] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:17:21 2022] DELETE /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 17:17:22.115941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:22.115941 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:22.121681 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:22.122387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:22.123347 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:22.123792 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:22.264396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.policy [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124835) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:22.272597 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-86121945-cab8-4458-b3ca-bc320c7c07d1 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1578 microversion: 2.1 time: 0.163027 Aug 01 17:17:22.273177 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 635/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:22 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:23.295647 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:23.296348 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:23.303080 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:23.303527 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:23.304276 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:23.304707 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:23.441726 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:23.449333 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ee222663-de9a-44e1-877e-f4351a7c043c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1460 microversion: 2.1 time: 0.157951 Aug 01 17:17:23.449840 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 625/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:23 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:24.270141 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [req-df160e60-46d5-40f6-a03c-50cd7beee320 req-3a7159ef-d440-43a4-b353-04d44037ef9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f17911-8e13-4327-808a-1b859ef0ccd9", "name": "network-vif-deleted", "tag": "915f91a8-1aa3-431a-b1c8-2cd151733fac"}]} {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 17:17:24.279909 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-df160e60-46d5-40f6-a03c-50cd7beee320 req-3a7159ef-d440-43a4-b353-04d44037ef9d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:24.280966 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [req-df160e60-46d5-40f6-a03c-50cd7beee320 req-3a7159ef-d440-43a4-b353-04d44037ef9d service nova] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:24.291936 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.compute.server_external_events [req-df160e60-46d5-40f6-a03c-50cd7beee320 req-3a7159ef-d440-43a4-b353-04d44037ef9d service nova] Creating event network-vif-deleted:915f91a8-1aa3-431a-b1c8-2cd151733fac for instance 06f17911-8e13-4327-808a-1b859ef0ccd9 on hv-cinder-84989 Aug 01 17:17:24.299196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [req-df160e60-46d5-40f6-a03c-50cd7beee320 req-3a7159ef-d440-43a4-b353-04d44037ef9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030855 Aug 01 17:17:24.299196 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 636/1261] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 1 17:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 17:17:24.471603 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:24.472252 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:24.479119 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:24.479509 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:24.480272 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:24.480705 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:24.543079 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca353ec7cb948c9a803e6422ea3476e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2cff009abd049a7aff67696680687ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 17:17:24.551514 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-376f2257-c2b2-47dd-8c16-fa2d899b2a1e tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 200 len: 1226 microversion: 2.1 time: 0.084323 Aug 01 17:17:24.552095 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 626/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:24 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 17:17:25.573317 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:25.573942 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 06f17911-8e13-4327-808a-1b859ef0ccd9] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:25.581387 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:25.581845 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:25.582667 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:25.583108 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:25.596701 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] HTTP exception thrown: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Request method failure captured: Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 HTTP/1.1 Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AisdjTPMvhPzEgV9VP0mmxBfQEdsIOetDPGdjesNdgxckRua1PutPcC8yf1oN8Jk4HnvFY7ii67AUT8PDzqWCDd9OdYhmqMfEIxJKHdXEyEScWrmctkf2szvZB8wcSi4cEuZcJzc3Dai8VzjhRMtmlFPrWdNWnnZEPijAes7_GU1Xw Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:17:25.598376 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2cff009abd049a7aff67696680687ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2cff009abd049a7aff67696680687ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 8ca353ec7cb948c9a803e6422ea3476e Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. Aug 01 17:17:25.599952 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '06f17911-8e13-4327-808a-1b859ef0ccd9'} Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:17:25.600812 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. Aug 01 17:17:25.602232 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:25.603809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Returning 404 to user: Instance 06f17911-8e13-4327-808a-1b859ef0ccd9 could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:17:25.603809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-d2f9eb1a-03ab-499a-939b-71e31e3ff93c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9" status: 404 len: 111 microversion: 2.1 time: 0.030771 Aug 01 17:17:25.603809 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 637/1263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:25 2022] GET /compute/v2.1/servers/06f17911-8e13-4327-808a-1b859ef0ccd9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:17:26.097880 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:26.098450 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:26.105192 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:26.105644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:26.106460 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:26.106897 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:26.120789 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] HTTP exception thrown: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Request method failure captured: Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b HTTP/1.1 Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept: application/json Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Connection: close Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Length: 0 Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Content-Type: application/json Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Host: 10.222.0.20 Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.10 Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABi6AisdjTPMvhPzEgV9VP0mmxBfQEdsIOetDPGdjesNdgxckRua1PutPcC8yf1oN8Jk4HnvFY7ii67AUT8PDzqWCDd9OdYhmqMfEIxJKHdXEyEScWrmctkf2szvZB8wcSi4cEuZcJzc3Dai8VzjhRMtmlFPrWdNWnnZEPijAes7_GU1Xw Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Id: None Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Domain-Name: None Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Role: member,reader Aug 01 17:17:26.122465 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Roles: member,reader Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2cff009abd049a7aff67696680687ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2cff009abd049a7aff67696680687ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Id: 8ca353ec7cb948c9a803e6422ea3476e Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: method: > Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: exception: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.124346 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: action_args: {'id': '39c61f5e-abd6-4e49-aad2-d828f46bfc7b'} Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:17:26.125359 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.127295 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.128977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Returning 404 to user: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:17:26.128977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-524e62c1-f1c8-4c75-8735-b98ae7fd7036 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 404 len: 111 microversion: 2.1 time: 0.029910 Aug 01 17:17:26.128977 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 627/1264] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 1 17:17:26 2022] DELETE /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:17:26.132832 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '>' {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:26.133440 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.compute.api [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] [instance: 39c61f5e-abd6-4e49-aad2-d828f46bfc7b] Fetching instance by UUID {{(pid=124835) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 17:17:26.139633 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:26.140630 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:26.141399 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 17:17:26.141847 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG oslo_concurrency.lockutils [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Lock "bcd62dae-a339-4b43-b5a0-7436faac276b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 17:17:26.157939 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.wsgi [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] HTTP exception thrown: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Request method failure captured: Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: request: GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b HTTP/1.1 Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept: application/json Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Accept-Encoding: identity Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Connection: close Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Length: 0 Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Content-Type: application/json Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Host: 10.222.0.20 Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Openstack-System-Scope: None Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: User-Agent: python-urllib3/1.26.10 Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Auth-Token: gAAAAABi6AisdjTPMvhPzEgV9VP0mmxBfQEdsIOetDPGdjesNdgxckRua1PutPcC8yf1oN8Jk4HnvFY7ii67AUT8PDzqWCDd9OdYhmqMfEIxJKHdXEyEScWrmctkf2szvZB8wcSi4cEuZcJzc3Dai8VzjhRMtmlFPrWdNWnnZEPijAes7_GU1Xw Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Id: None Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Domain-Name: None Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Identity-Status: Confirmed Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Is-Admin-Project: True Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Id: default Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Domain-Name: Default Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Project-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Role: member,reader Aug 01 17:17:26.159394 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Roles: member,reader Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2cff009abd049a7aff67696680687ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2cff009abd049a7aff67696680687ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2cff009abd049a7aff67696680687ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}] Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Id: c2cff009abd049a7aff67696680687ca Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1835059375 Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Id: default Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Domain-Name: Default Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Id: 8ca353ec7cb948c9a803e6422ea3476e Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: X-User-Name: tempest-TestVolumeBootPattern-1835059375-project Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: method: > Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: exception: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.161202 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: action_args: {'id': '39c61f5e-abd6-4e49-aad2-d828f46bfc7b'} Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: {{(pid=124835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 17:17:26.162413 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. Aug 01 17:17:26.164852 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: ERROR nova.api.openstack.wsgi Aug 01 17:17:26.166439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: DEBUG nova.api.openstack.wsgi [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Returning 404 to user: Instance 39c61f5e-abd6-4e49-aad2-d828f46bfc7b could not be found. {{(pid=124835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 17:17:26.166439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO nova.api.openstack.requestlog [None req-c0065643-03f2-401c-9b98-38504dec4a02 tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b" status: 404 len: 111 microversion: 2.1 time: 0.031669 Aug 01 17:17:26.166439 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: [pid: 124835|app: 0|req: 638/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 1 17:17:26 2022] GET /compute/v2.1/servers/39c61f5e-abd6-4e49-aad2-d828f46bfc7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 17:17:27.645226 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7840597e-28d4-488a-b37d-baaea891835c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] Calling method '.version_select at 0x7f7342383dc0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 17:17:27.738644 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7840597e-28d4-488a-b37d-baaea891835c tempest-TestVolumeBootPattern-1835059375 tempest-TestVolumeBootPattern-1835059375-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1131523973" status: 202 len: 0 microversion: 2.1 time: 0.097265 Aug 01 17:17:27.739220 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 628/1266] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Aug 1 17:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1131523973 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 17:20:08.296396 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:08.297026 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:20:09.329117 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:09.329698 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:20:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:20:18.434786 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:18.435391 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:20:20.575039 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:20.575692 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:20:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:20:23.778467 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:23.779074 dv-cinder-849890-2-iscsi devstack@n-api.service[124837]: Mon Aug 1 17:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:20:26.411734 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:20:26.412448 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:23:28.304730 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:23:28.305377 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:23:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 17:23:29.337266 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 17:23:29.337842 dv-cinder-849890-2-iscsi devstack@n-api.service[124835]: Mon Aug 1 17:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!